Can ChatGPT-4 Diagnose in Turkish: A Comparison of ChatGPT Responses to Health-related Questions in English and Turkish

11 Pages Posted: 31 May 2023

See all articles by Mustafa Said Yıldız

Mustafa Said Yıldız

Republic of Türkiye Ministry of Health

Ayfer Alper

Ankara University

Date Written: May 25, 2023

Abstract

OpenAI's machine learning-based ChatGPT implementation has become a trending topic in the first quarter of 2023. Comparative assessment of the health information provided by ChatGPT in Turkish with the health information provided in English is the purpose of this study. Comparison between English answer to English question and English translation of Turkish answer to Turkish question is made by five gastroenterology specialists for their comprehesiveness and accuracy. Turkish responses of ChatGPT were assessed as correct as English responses and less comprehensive but not evaluated as “inadequate”. It was found that ChatGPT could be used for medical purposes in Turkish language.

Note:
Funding Information: None.

Conflict of Interests: None.

Keywords: ChatGPT-4, health information, language bias

Suggested Citation

Yıldız, Mustafa Said and Alper, Ayfer, Can ChatGPT-4 Diagnose in Turkish: A Comparison of ChatGPT Responses to Health-related Questions in English and Turkish (May 25, 2023). Available at SSRN: https://ssrn.com/abstract=4459545 or http://dx.doi.org/10.2139/ssrn.4459545

Mustafa Said Yıldız (Contact Author)

Republic of Türkiye Ministry of Health ( email )

Ayfer Alper

Ankara University ( email )

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
73
Abstract Views
463
Rank
637,021
PlumX Metrics