Testing Creativity of ChatGPT in Psychology: Interview with ChatGPT

11 Pages Posted: 22 Mar 2023

See all articles by Kadir Uludag

Kadir Uludag

Shanghai Jiao Tong University (SJTU) - Shanghai Mental Health Center

Date Written: March 16, 2023

Abstract

Background: ChatGPT is a large language model trained on a vast amount of text and can generate human-like responses to natural language queries. However, the extent to which ChatGPT can be considered a creative system is still unclear. There is a need to develop methods to test the creativity of ChatGPT and assess its potential for generating novel and valuable responses. In this study, we have only focused on the creativity of ChatGPT in the field of psychology.

Methods: In this study, we asked questions for testing the creativity of ChatGPT. We used a combination of quantitative and qualitative methods to evaluate the creative potential of ChatGPT. We assessed the novelty and usefulness of ChatGPT-generated responses. However, it is not clear how to assess the novelty of ChatGPT.

Results: Our results suggest that ChatGPT has the potential to generate creative responses.. Additionally, the responses generated by ChatGPT were found to be similar in quality to those developed by human experts in certain domains. ChatGPT could produce texts by logic without directly citing previous texts. For example, ChatGPT could give an example of delusional grammar. However, it cannot be used to find a novel solution for psychological problems. Also, psychological recommendations are repetitive and limited by the system.

Conclusion: The results of this study demonstrate that ChatGPT has the potential to be a creative system. The framework developed in this study can be used to test the creativity of other language models and assess their potential for generating novel and useful responses. Further research is needed to optimize the design of ChatGPT and explore its potential for generating creative responses in different domains.

Keywords: creativity, ChatGPT, artificial intelligence, chatbots

Suggested Citation

Uludag, Kadir, Testing Creativity of ChatGPT in Psychology: Interview with ChatGPT (March 16, 2023). Available at SSRN: https://ssrn.com/abstract=4390872 or http://dx.doi.org/10.2139/ssrn.4390872

Kadir Uludag (Contact Author)

Shanghai Jiao Tong University (SJTU) - Shanghai Mental Health Center ( email )

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
1,320
Abstract Views
3,533
Rank
29,457
PlumX Metrics