puc-header

Brain-Inspired Theory of Mind Spiking Neural Network Elevates Multi-Agent Cooperation and Competition

27 Pages Posted: 9 Nov 2022 Publication Status: Published

See all articles by Zhuoya Zhao

Zhuoya Zhao

Chinese Academy of Sciences (CAS) - Research Center for Brain-inspired Intelligence

Feifei Zhao

Chinese Academy of Sciences (CAS) - Research Center for Brain-inspired Intelligence

Yuxuan Zhao

Chinese Academy of Sciences (CAS) - Brain-inspired Cognitive Intelligence Lab

Yi Zeng

Chinese Academy of Sciences (CAS) - Brain-inspired Cognitive Intelligence Lab

Yinqian Sun

Chinese Academy of Sciences (CAS) - Brain-inspired Cognitive Intelligence Lab

More...

Abstract

Theory of mind (ToM), a kind of high social cognitive ability, enables individuals to infer others’ mental states and thus explain and predict others’ behaviors. During dynamic social interaction, inferring and predicting others’ behaviors through ToM is crucial for obtaining more benefits in cooperative and competitive tasks. However, most existing multi-agent decision-making methods select behaviors based on agents’ observations, lacking in-depth inspiration from the ToM mechanism in the brain and thus limiting the performance of multi-agent decision-making. In this paper, we proposed a Multi-Agent Theory of Mind Spiking Neural Network (MAToM-SNN) model, which consists of a ToM model and a decision-making module. We designed two brain-inspired ToM modules (Self-ToM and Other-ToM) to predict others’ behavior based on self-experience and observations of others, respectively. Then, each agent will adjust its behavior according to the predicted actions of others. The proposed model has been verified in multi-agent decision-making environments with cooperative and competitive tasks. The experimental results show that introducing ToM and SNNs could improve cooperation efficiency and help achieve higher rewards compared to multi-agent reinforcement learning models. Especially for competitive tasks, the agents with ToM could improve the rewards of their team by predicting the actions of other agents.

Keywords: Theory of Mind, Multi-Agent Reinforcement Learning, Spiking
 Neural Network, Social Cooperation and Competition

Suggested Citation

Zhao, Zhuoya and Zhao, Feifei and Zhao, Yuxuan and Zeng, Yi and Sun, Yinqian, Brain-Inspired Theory of Mind Spiking Neural Network Elevates Multi-Agent Cooperation and Competition. Available at SSRN: https://ssrn.com/abstract=4271099 or http://dx.doi.org/10.2139/ssrn.4271099
This version of the paper has not been formally peer reviewed.

Zhuoya Zhao (Contact Author)

Chinese Academy of Sciences (CAS) - Research Center for Brain-inspired Intelligence ( email )

Feifei Zhao

Chinese Academy of Sciences (CAS) - Research Center for Brain-inspired Intelligence ( email )

Yuxuan Zhao

Chinese Academy of Sciences (CAS) - Brain-inspired Cognitive Intelligence Lab ( email )

Yi Zeng

Chinese Academy of Sciences (CAS) - Brain-inspired Cognitive Intelligence Lab ( email )

Yinqian Sun

Chinese Academy of Sciences (CAS) - Brain-inspired Cognitive Intelligence Lab ( email )

Click here to go to Cell.com

Paper statistics

Downloads
32
Abstract Views
1,037
PlumX Metrics