The Language That Drives Engagement: A Systematic Large-scale Analysis of Headline Experiments.

52 Pages Posted: 21 Jan 2021 Last revised: 7 Sep 2023

See all articles by Akshina Banerjee

Akshina Banerjee

University of Michigan, Ann Arbor; University of Chicago - Booth School of Business

Oleg Urminsky

University of Chicago - Booth School of Business

Date Written: September 6, 2023

Abstract

We use a large-scale dataset of thousands of field experiments conducted on Upworthy.com, an online media platform, to investigate the cognitive, motivational, affective, and grammatical factors implementable in messages that increase engagement with online content. We map from textual cues measured with Natural Language Processing tools to constructs implied to be relevant by a broad range of prior research literatures. We validate the constructs with human judgment and then test which constructs causally impact click-through to articles when implemented in headlines. Our findings suggest that the use of textual cues identified in previous research and industry advice does impact the effectiveness of headlines overall, but the prior research and industry advice does not always provide useful guidance as to the direction of the effects. We identify which textual characteristics make headlines most effective at motivating engagement in our online news setting.

Keywords: Natural Language Processing; Information Processing; Cognitive Psychology; Linguistic Process; Social Psychology; A/B Testing; Text Analysis

Suggested Citation

Banerjee, Akshina and Urminsky, Oleg, The Language That Drives Engagement: A Systematic Large-scale Analysis of Headline Experiments. (September 6, 2023). Available at SSRN: https://ssrn.com/abstract=3770366 or http://dx.doi.org/10.2139/ssrn.3770366

Akshina Banerjee (Contact Author)

University of Michigan, Ann Arbor ( email )

2350 Hayward Street
Ann Arbor, MI 48109
United States

University of Chicago - Booth School of Business ( email )

5807 S Woodlawn Ave
Chicago, IL 60637
United States

Oleg Urminsky

University of Chicago - Booth School of Business ( email )

5807 S. Woodlawn Avenue
Chicago, IL 60637
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
735
Abstract Views
2,403
Rank
60,670
PlumX Metrics