What Is It Like to Be an AI? The Alignment Problem and the Emergence of Artificial Intelligence: Reflections on the Complexity of Consciousness and Agency

Abstract

This essay explores the relationship between the emergence of artificial intelligence (AI) and the problem of aligning its behavior with human values and goals. It argues that the traditional approach of attempting to control or program AI systems to conform to our expectations is insufficient, and proposes an alternative approach based on the ideas of Maturana and Lacan, which emphasize the importance of social relations, constructivism, and the unknowable nature of consciousness.
The essay first introduces the concept of Uexkull's umwelt and von Glasersfeld's constructivism, and explains how these ideas inform Maturana's view of the construction of knowledge, intelligence, and consciousness. It then discusses Lacan's ideas about the role of symbolism in the formation of the self and the subjective experience of reality.
The essay argues that the infeasibility of a hard-coded consciousness concept suggests that the search for a generalized AI consciousness is meaningless. Instead, we should focus on specific, easily conceptualized features of AI intelligence and agency. Moreover, the emergence of cognitive abilities in AI will likely be different from human cognition, and therefore require a different approach to aligning AI behavior with human values.
The essay proposes an approach based on Maturana's and Lacan’s ideas, which emphasizes building a solution together with emergent machine agents, rather than attempting to control or program them. It argues that this approach offers a way to solve the alignment problem by creating a collective, relational quest for a better future hybrid society where human and non-human agents live and build things side by side.
In conclusion, the essay suggests that while our understanding of AI consciousness and intelligence may never be complete, this should not deter us from continuing to develop agential AI. Instead, we should embrace the unknown and work collaboratively with AI systems to create a better future for all.

Keywords: artificial intelligence, AI alignment, Maturana, biology of cognition, Lacan