Comparison of Approaches for Gathering Data from the Web for Technology Trend Analysis
27 Pages Posted: 11 Mar 2009
Date Written: August 1, 2008
Abstract
We are investigating trend extrapolation using historical data from academic publications to forecast future technology directions. Many sources of academic information on the Web (e.g., Google Scholar, Scirus) provide a wealth of relevant information, yet they are not structured for programmatic access. We can use Web wrappers, programs that can harvest text data from Web pages and present them in a structured format, to overcome this problem.
JEL Classification: trend analysis, web wrappers, google scholar
Suggested Citation: Suggested Citation
Kaya Firat, Ayse and Woon, Wei Lee and Madnick, Stuart E., Comparison of Approaches for Gathering Data from the Web for Technology Trend Analysis (August 1, 2008). MIT Sloan Research Paper No. 4727-09, Available at SSRN: https://ssrn.com/abstract=1356047 or http://dx.doi.org/10.2139/ssrn.1356047
Do you have negative results from your research you’d like to share?
Feedback
Feedback to SSRN
If you need immediate assistance, call 877-SSRNHelp (877 777 6435) in the United States, or +1 212 448 2500 outside of the United States, 8:30AM to 6:00PM U.S. Eastern, Monday - Friday.