Testing Creativity of ChatGPT in Psychology: Interview with ChatGPT

Abstract

Background: ChatGPT is a large language model trained on a vast amount of text and can generate human-like responses to natural language queries. However, the extent to which ChatGPT can be considered a creative system is still unclear. There is a need to develop methods to test the creativity of ChatGPT and assess its potential for generating novel and valuable responses. In this study, we have only focused on the creativity of ChatGPT in the field of psychology.

Methods: In this study, we asked questions for testing the creativity of ChatGPT. We used a combination of quantitative and qualitative methods to evaluate the creative potential of ChatGPT. We assessed the novelty and usefulness of ChatGPT-generated responses. However, it is not clear how to assess the novelty of ChatGPT.

Results: Our results suggest that ChatGPT has the potential to generate creative responses.. Additionally, the responses generated by ChatGPT were found to be similar in quality to those developed by human experts in certain domains. ChatGPT could produce texts by logic without directly citing previous texts. For example, ChatGPT could give an example of delusional grammar. However, it cannot be used to find a novel solution for psychological problems. Also, psychological recommendations are repetitive and limited by the system.

Conclusion: The results of this study demonstrate that ChatGPT has the potential to be a creative system. The framework developed in this study can be used to test the creativity of other language models and assess their potential for generating novel and useful responses. Further research is needed to optimize the design of ChatGPT and explore its potential for generating creative responses in different domains.

Keywords: creativity, ChatGPT, artificial intelligence, chatbots