Download This PaperThe Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers
38 Pages Posted: 5 Sep 2024 Last revised: 21 Aug 2025
Date Written: August 20, 2025
Abstract
This study evaluates the effect of generative AI on software developer productivity via randomized controlled trials at Microsoft, Accenture, and an anonymous Fortune 100 company. These field experiments, run by the companies as part of their ordinary course of business, provided a random subset of developers with access to an AI-based coding assistant suggesting intelligent code completions. Though each experiment is noisy and results vary across experiments, when data is combined across three experiments and 4,867 developers, our analysis reveals a 26.08% increase (SE: 10.3%) in completed tasks among developers using the AI tool. Notably, less experienced developers had higher adoption rates and greater productivity gains.
JEL Classification: J24, O32, O33
Suggested Citation: Suggested Citation
Mert Demirer
Massachusetts Institute of Technology (MIT) - Sloan School of Management ( email )
100 Main Street
E62-416
Cambridge, MA 02142
United States
Leon Musolff (Contact Author)
University of Pennsylvania - Business & Public Policy Department ( email )
3641 Locust Walk
Philadelphia, PA 19104-6372
United States