Can ChatGPT-4 Diagnose in Turkish: A Comparison of ChatGPT Responses to Health-related Questions in English and Turkish

Abstract

OpenAI's machine learning-based ChatGPT implementation has become a trending topic in the first quarter of 2023. Comparative assessment of the health information provided by ChatGPT in Turkish with the health information provided in English is the purpose of this study. Comparison between English answer to English question and English translation of Turkish answer to Turkish question is made by five gastroenterology specialists for their comprehesiveness and accuracy. Turkish responses of ChatGPT were assessed as correct as English responses and less comprehensive but not evaluated as “inadequate”. It was found that ChatGPT could be used for medical purposes in Turkish language.

Note:
Funding Information: None.

Conflict of Interests: None.

Keywords: ChatGPT-4, health information, language bias