All the News that’s Fit to Fabricate: AI-Generated Text as a Tool of Media Misinformation

19 Pages Posted: 21 Feb 2020 Last revised: 28 Sep 2020

See all articles by Sarah E. Kreps

Sarah E. Kreps

Cornell University

Miles McCain

affiliation not provided to SSRN

Miles Brundage

Independent

Date Written: September 24, 2020

Abstract

Online misinformation has become a constant; only the way actors create and distribute that information is changing. Advances in artificial intelligence (AI) mean that actors can now synthetically generate text in ways that mimic the style and substance of human-created news stories. We carried out three original experiments to study whether these AI-generated texts are credible and can influence opinions on foreign policy — a likely target of real-world misinformation. The first evaluated human detection of AI-generated text relative to the original story from which it was generated. The second examined the credibility distribution across different model sizes to gauge whether improvements in processing produce commensurate increases in credibility. The third investigated the interaction between partisanship and AI-generated news. We find that individuals are largely incapable of distinguishing between AI and human-generated text; partisanship affects the perceived credibility of the story; and exposure to the text does little to change individuals’ policy views. The findings have important implications for the way malicious actors might employ AI in online misinformation campaigns and electoral interference.

Suggested Citation

Kreps, Sarah E. and McCain, Miles and Brundage, Miles, All the News that’s Fit to Fabricate: AI-Generated Text as a Tool of Media Misinformation (September 24, 2020). Available at SSRN: https://ssrn.com/abstract=3525002 or http://dx.doi.org/10.2139/ssrn.3525002

Sarah E. Kreps (Contact Author)

Cornell University ( email )

Ithaca, NY 14853
United States

Miles McCain

affiliation not provided to SSRN

Miles Brundage

Independent ( email )

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
1,970
Abstract Views
16,533
Rank
17,898
PlumX Metrics