Aggregation Bias in Sponsored Search Data: The Curse and The Cure
Carnegie Mellon University - H. John Heinz III School of Public Policy and Management
University of Pennsylvania - Operations & Information Management Department
University of Pennsylvania - Marketing Department
March 7, 2011
There has been significant recent interest in studying consumer behavior in sponsored search advertising (SSA). Researchers have typically used daily data from search engines containing measures such as average bid, average ad position, total impressions, clicks and cost for each keyword in the advertiser's campaign. A variety of random utility models have been estimated using such data and the results have helped researchers explore the factors that drive consumer click and conversion propensities. However, virtually every analysis of this kind has ignored the intra-day variation in ad position. We show that estimating random utility models on aggregated (daily) data without accounting for this variation will lead to systematically biased estimates -- specifically, the impact of ad position on click-through rate (CTR) is attenuated and the predicted CTR is higher than the actual CTR. We demonstrate the existence of the bias analytically and show the effect of the bias on the equilibrium of the SSA auction. Using a large dataset from a major search engine, we measure the magnitude of bias and quantify the losses suffered by the search engine and an advertiser using aggregate data. The search engine loses around 0.43\textcent/impression (or 17\% in our analysis) due to aggregation bias. We also present a few data summarization techniques that can be used by search engines to reduce or eliminate the bias.
Number of Pages in PDF File: 41
Keywords: e-commerce, sponsored search, online advertising, aggregation bias, econometrics, probabilistic modeling, consumer behavior, generalized second price auctions
JEL Classification: C13, M37working papers series
Date posted: October 20, 2009 ; Last revised: December 28, 2012
© 2014 Social Science Electronic Publishing, Inc. All Rights Reserved.
This page was processed by apollo1 in 0.500 seconds