Comparison of Approaches for Gathering Data from the Web for Technology Trend Analysis
27 Pages Posted: 11 Mar 2009
Date Written: August 1, 2008
We are investigating trend extrapolation using historical data from academic publications to forecast future technology directions. Many sources of academic information on the Web (e.g., Google Scholar, Scirus) provide a wealth of relevant information, yet they are not structured for programmatic access. We can use Web wrappers, programs that can harvest text data from Web pages and present them in a structured format, to overcome this problem.
JEL Classification: trend analysis, web wrappers, google scholar
Suggested Citation: Suggested Citation