A predictive human model of language challenges traditional views in linguistics and pretrained transformer research
Language and Semiotic Studies January 2, 2025 DOI: 10.1515/lass-2024-0018 via DOAJ
Summary
AI-generated from the abstractLanguage is a cognitive tool that evolved to optimize biological fitness by allowing humans to reconstruct reality through memory and adaptation to uncertainty, reaffirming the Self-as-symbol. Pretrained language models like ChatGPT lack embodied grounding and conscious states, preventing them from adequately modeling the world through language. Human representation cannot be reduced to data structures; transformers are posthuman agents, while humans are purposeful biological agents capable of adjustment and optimization. The capacity to integrate information does not equal phenomenal consciousness, as Information Integration Theory claims. Language models, despite superior computation, lack real consciousness and multiscalar physical experience. The paper anticipates future in silico conceptualizers that may define themselves as phenomenal agents with symbolic contours and goals.
Study at a glance
| Characteristics | Theoretical or philosophical paper Peer reviewed |
|---|---|
| Keywords | Active inference Chatgpt Embodiment Essentialist concept formation Large language models |
| Citations | 7 |
| Key finding | Human language-based representation is grounded in embodied, conscious experience, unlike pretrained language models, which lack subjecthood and phenomenal consciousness. |
Abstract
This paper introduces a theory of mind that positions language as a cognitive tool in its own right for the optimization of biological fitness. I argue that human language reconstruction of reality results from biological memory and adaptation to uncertain environmental conditions for the reaffirmation of the Self-as-symbol. I demonstrate that pretrained language models, such as ChatGPT, lack embodied grounding, which compromises their ability to adequately model the world through language due to the absence of subjecthood and conscious states for event recognition and partition. At a deep level, I challenge the notion that the constitution of a semiotic Self relies on computational reflection, arguing against reducing human representation to data structures and emphasizing the importance of positing accurate models of human representation through language. This underscores the distinction between transformers as posthuman agents and humans as purposeful biological agents, which emphasizes the human capacity for purposeful biological adjustment and optimization. One of the main conclusions of this is that the capacity to integrate information does not amount to phenomenal consciousness as argued by Information Integration Theory. Moreover, while language models exhibit superior computational capacity, they lack the real consciousness providing them with multiscalar experience anchored in the physical world, a characteristic of human cognition. However, the paper anticipates the emergence of new in silico conceptualizers capable of defining themselves as phenomenal agents with symbolic contours and specific goals.