Friend or Foe? The Interaction Between Human and Artificial Intelligence on Performance in Medical Chart Coding

Abstract

As AI applications become more pervasive, it is critical to understand how knowledge workers with different levels and types of experience can team with AI for productivity gains. We focus on the influence of two major types of human work experience, narrow experience based on the specific task volume and broad experience based on seniority, on the human-AI team dynamics. We developed an AI solution for medical chart coding in a publicly traded company and conducted a field study among the knowledge workers. Based on a detailed analysis performed at the medical chart level, we find evidence that AI benefits workers with greater task-based experience, but senior workers gain less from AI than their junior colleagues. Further investigation reveals that the relatively lower productivity lift from AI is not a result of seniority per se, but lower trust in AI, likely triggered by the senior workers’ broader job responsibilities. This study provides new empirical insights into the differential roles of worker experience in the collaborative dynamics between AI and knowledge workers, which have important societal and business implications.

Keywords: artificial intelligence, productivity, worker skills, healthcare, medical coding