GPT in the Loop: Evidence from the Field

11 Pages Posted: 20 Dec 2023

See all articles by Cathy L. Yang

Cathy L. Yang

HEC Paris - Department of Information Systems and Operations Management

Leo Allen

HEC Paris

David Restrepo-Amariles

HEC Paris - Tax & Law

Aurore Troussel

HEC Paris - Tax & Law; University of Montreal - Faculty of Law

Date Written: December 8, 2023

Abstract

Generative Pre-trained Transformers (GPTs) are highly effective in generating content and increasing productivity, but companies have reservations about their use in a professional setting. OpenAI and policymakers suggest that disclosing the use of GPT is necessary, but there is little empirical evidence to understand its consequences. Our experiment found that managers from a leading consulting firm were unable to distinguish Human-GPT generated content when the content generation source was not disclosed and disclosing the use of GPT improved the content’s evaluation. We explored the effects of applying the GPT disclosure policy in the workplace. Managers prefer analysts to disclose their use of GPT, but their preferences regarding how junior analysts should use GPT may differ from those of the analysts, leading to potential conflicts over disclosure.

Keywords: Human-GPT collaboration, GPT disclosure, content evaluation, survey experiment

Suggested Citation

Yang, Cathy L. and Allen, Leo and Restrepo-Amariles, David and Troussel, Aurore, GPT in the Loop: Evidence from the Field (December 8, 2023). Available at SSRN: https://ssrn.com/abstract=4658765 or http://dx.doi.org/10.2139/ssrn.4658765

Cathy L. Yang

HEC Paris - Department of Information Systems and Operations Management ( email )

Paris
France

Leo Allen (Contact Author)

HEC Paris ( email )

1 rue de la Liberation
Jouy-en-Josas Cedex, 78351
France

David Restrepo-Amariles

HEC Paris - Tax & Law ( email )

1 rue de la Libération
Jouy-en-Josas Cedex, 78351
France

Aurore Troussel

HEC Paris - Tax & Law ( email )

1 rue de la Libération
Jouy-en-Josas Cedex, 78351
France

University of Montreal - Faculty of Law ( email )

Montreal, Quebec H3T 1B9
Canada

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
187
Abstract Views
548
Rank
322,009
PlumX Metrics