How to Gather Data Using a Web Crawler: An Application Using SAS to Search Edgar
14 Pages Posted: 9 Oct 2007
Date Written: 2007
Abstract
Empirical researchers in economics, finance and accounting grapple with a fundamental problem of gathering a representative sample of firms to test various theories that abound in the literature. Several well established data vendors provide a wealth of information toward this endeavor. However, data providers only provide a portion of information available. In this paper we provide a simple SAS program that can search for particular phrases in any Form filed by a registrant with the SEC. This allows researchers to "crawl" the web and access a large trove of data disclosed by managers in their public filings.
Keywords: Data gathering, Web crawling
JEL Classification: G00, M40, M41, M46
Suggested Citation: Suggested Citation
Do you have negative results from your research you’d like to share?
Recommended Papers
-
By Axel Ockenfels and Alvin E. Roth
-
An Experimental Analysis of Ending Rules in Internet Auctions
By Dan Ariely, Axel Ockenfels, ...
-
By Stanley S. Reynolds and John Wooders
-
Strategic Implications of Uncertainty Over One's Own Private Value in Auctions
-
By Axel Ockenfels, David Reiley, ...
-
Temporary and Permanent Buyout Prices in Online Auctions
By Shobhit Gupta and Jérémie Gallien
-
Buy it Now: A Hybrid Internet Market Institution
By Steven T. Anderson, Daniel Friedman, ...
-
By Steven T. Anderson, Daniel Friedman, ...
-
Ebay's Proxy System: A License to Shill
By Joseph Engelberg and Jared Williams