GrytLabs Research Institute
Research Report · WMI Thesis Series
Language, Cognition & World Models: Why the Linguistic Layer Is Irreducible
How Speech Acts Constitute Organizational Reality and Why World Models Need the Linguistic Layer
Cameisha Smith, CIA
ORCID 0009-0002-8178-8380
RR-019  v1.0  ·  Research 2026-03-19  ·  Published 2026-07-06
CC-BY 4.0  ·  DOI 10.5281/zenodo.20236831
Abstract
The AI world model discourse frames a false binary: language models versus world models. LeCun argues that animals build world models without language, therefore text is unnecessary. This research resolves the binary through a domain-sensitive analysis grounded in speech act theory. Austin, Searle, and Winograd & Flores establish that certain organizational structures — authority delegations, normative constraints, declared purpose — are linguistically constituted: they are brought into existence through speech acts, not described by them. A three-category mapping emerges: language is irreducible for three world model ingredients in organizational domains, beneficial for four, and unnecessary for three. The mutable-institutional-reality argument permanently resolves the evolutionary priority objection: animals have fixed governance (genetically channeled); only humans constitute and change governance through declaration. LLMs are cognitive infrastructure extending linguistic processing in the lineage of writing, printing, and computing.

Institutional facts — money, property, marriage, corporations, legal authority — exist only because of collective acceptance of systems of constitutive rules.

— paraphrasing Searle (1995), *The Construction of Social Reality*

Contents
§1Query Objective
§2Executive Summary
§3Literature Review
§4Scope + Limitations
§5Research Synthesis
§6Open Questions
§7Citations & Provenance
Cite As & Publication Notice

§1Query Objective

The Inquiry: The AI world model discourse contains a paradox: LeCun and colleagues argue that text is a "crutch" and that animals build world models without language, while simultaneously describing world model components (planners, configurators, goal-setters) that require linguistically constituted structures to function in organizational domains. Is language merely a modality for world models (replaceable by better perception), or does it occupy an irreducible architectural position — one where certain world model ingredients can only be constituted through linguistic acts?

Falsifiable formulation: If the three world model ingredients claimed to be linguistically constituted (relational structure among governance roles, normative constraints, and declared organizational purpose) can be fully instantiated in organizational domains without any linguistic mechanism — without declarations, contracts, policies, commitments, or other speech acts — then language is not architecturally irreducible and the claim here does not hold.

§2Executive Summary

The field's binary dissolves — but not into mush

The AI world model discourse frames a false binary: language models vs. world models. LeCun argues world models should be learned from sensory experience, not text. The language model community argues that scaling text prediction produces emergent world understanding. Both positions contain insight and error.

The synthesis: language's role in world models is not uniform but ingredient-specific. For physical-world prediction (object permanence, spatial reasoning, dynamic simulation), language is unnecessary — animals demonstrate this, and LeCun is correct that text is not the optimal training signal. For organizational governance (authority delegation, constraint constitution, purpose declaration), language is irreducible — governance structures are linguistically constituted and cannot exist without speech acts.

The three-category mapping (F7) — irreducible, beneficial, unnecessary — provides the formal resolution. It does not disagree with JEPA for physical domains. It extends the world model concept to domains where institutional reality is linguistically constituted. The resolution is architectural, not polemical.

Figure 1Language's role in world model architecture is ingredient-specific, not uniform
Figure 1. Language's role in world model architecture is ingredient-specific, not uniform.
The Austin → Searle → Winograd & Flores lineage is the direct intellectual ancestor

The speech act tradition provides the philosophical foundation. Austin (1962) established that some language constitutes rather than describes. Searle (1969, 1995, 2010) formalized institutional facts through "X counts as Y in C" and status function declarations. Winograd & Flores (1986) applied this directly to organizational computing through conversations for action. The lineage is direct: organizational governance is constituted through speech acts, and governance infrastructure must operate at the linguistic level where constitution occurs.

Figure 2The speech act tradition provides the direct intellectual lineage for governance substrate design
Figure 2. The speech act tradition provides the direct intellectual lineage for governance substrate design.
The mutable-institutional-reality argument resolves the evolutionary objection

Animals have world models without language — correct for fixed governance (pack hierarchy, colony roles). Animals cannot change governance through declaration — this is exclusively human and requires language. Organizational governance is mutable — created, modified, and replaced through speech acts. Therefore language is irreducible for organizational world models. The argument is not that animals lack world models (they don't) but that mutable institutional reality requires linguistic constitution (it does).

LLMs are cognitive infrastructure, not cognitive replacement

The extended mind thesis (Clark & Chalmers), distributed cognition (Hutchins), and the history of cognitive technology (Ong) establish that cognitive processes extend beyond the brain through tools. Writing extended memory. Printing extended distribution. Computing extended calculation. LLMs extend linguistic processing. They are the natural cognitive extension for the linguistic layer of world model operation — not replacing human governance cognition but amplifying it beyond individual bandwidth.

§3Literature Review

F1
Human language differs from animal communication not in degree but in kind — it is an open system with architectural properties no other communication system possesses.
Type  convergent (linguistics + evolutionary biology + cognitive science)
Strength  meta-analytic (Hockett foundational, HCF highly cited, Deacon and Tomasello provide independent grounding)

Hockett (1960) identified 13 design features of language in Scientific American. While animal communication systems share some features, four are particularly developed in or characteristic of human language (though some, like displacement, appear in limited forms in other species — e.g., bee-dancing communicates about distant food sources): (1) Displacement — referring to things not present in space or time (past events, future commitments, hypothetical scenarios), (2) Productivity — creating and understanding utterances never before produced (novel governance structures, unprecedented policies), (3) Cultural transmission — language is learned, not innate (governance vocabulary is acquired, not genetically encoded), (4) Duality of patterning — meaningless elements (phonemes) combine into meaningful elements (morphemes/words) that further combine into infinite structures. Hauser, Chomsky & Fitch (2002) in Science proposed that recursion — the capacity to generate infinite structures from finite elements — may be the only uniquely human component of the faculty of language (FLN), distinguishing the faculty of language in the narrow sense from the broader faculty (FLB) that includes sensory-motor and conceptual-intentional systems shared with other species. Deacon (1997) argued that human brains and language co-evolved — language is not merely a tool the brain uses but a force that shaped brain architecture. Tomasello (2008) grounded language origins in shared intentionality — the uniquely human capacity for cooperative communication requires understanding others as intentional agents with shareable goals.

The architectural implication: language provides an open generative system — finite elements, infinite compositions. Animal communication is closed — fixed repertoire of signals for fixed situations. Organizational governance requires the open system because governance structures are not fixed — they are created, modified, contested, and replaced through linguistic acts. A wolf pack's hierarchy is genetically channeled. A corporation's governance structure is linguistically constituted.

F2
Some language constitutes reality rather than describing it — and institutional governance is entirely constituted through such acts.
Type  theoretical (philosophy of language)
Strength  theoretical argument (Austin foundational; Searle's institutional ontology widely cited and debated)

Austin (1962) established in How to Do Things with Words that language is not merely descriptive. Performative utterances — "I hereby appoint you," "The board resolves that," "This contract binds the parties to" — do not describe a pre-existing reality; they bring a new reality into existence. Austin distinguished three acts performed in any utterance: the locutionary act (producing a meaningful expression), the illocutionary act (the conventional force — asserting, promising, ordering, declaring), and the perlocutionary act (the actual effect on the hearer). The illocutionary dimension — the force that makes a statement a commitment, a question a request, a declaration a constitutive act — is the mechanism through which institutional reality is constructed.

Searle (1969, 1995, 2010) formalized this through his institutional facts framework. In The Construction of Social Reality (1995), Searle established the formula "X counts as Y in context C": a piece of paper (X) counts as money (Y) in the United States (C). Institutional facts — money, property, marriage, corporations, legal authority — exist only because of collective acceptance through language. They differ from "brute facts" (physical facts independent of human cognition) in that they require linguistic constitution. In Making the Social World (2010), Searle argued that all institutional reality derives from "Status Function Declarations" — linguistic acts that assign deontic powers (rights, obligations, authority) to entities. Constitutive rules — rules that do not merely regulate an existing activity but create the very possibility of that activity (the rules of chess don't regulate a pre-existing game; they constitute it) — are the building blocks of all institutional reality.

The governance implication is direct: organizational governance is entirely constituted through speech acts. A policy IS a declaration, not a description of one. An authority delegation IS a performative act, not a report of one. A commitment IS a promise, not documentation of one. Without the linguistic act, the governance structure does not exist. This is not a metaphorical claim — it is an ontological one. Governance structures have no existence independent of the linguistic acts that constitute them.

F3
Winograd & Flores established the direct intellectual lineage from speech act theory to organizational governance systems.
Type  theoretical (applied philosophy of language to computing)
Strength  theoretical argument (highly influential in CSCW and organizational computing)

Winograd & Flores (1986) in Understanding Computers and Cognition applied Austin and Searle's speech act theory directly to organizational computing. Their central insight: organizations coordinate through "conversations for action" — structured exchanges of speech acts (requests, commitments, assertions, declarations) that constitute organizational work, not merely describe it. The network of speech acts — requests followed by commitments followed by assertions of completion followed by declarations of satisfaction — constitutes the organizational coordination process. Winograd & Flores argued that computer systems should be designed not as information processors but as tools for coordinating linguistic action — supporting the speech acts through which organizational reality is constructed and maintained.

This is the most direct intellectual ancestor of governance infrastructure design. The conversations-for-action model — where organizational coordination is constituted by structured speech acts, not merely documented by information systems — provides the theoretical foundation for any governance substrate that treats governance as constitutive (creating organizational reality) rather than descriptive (recording what happened).

F4
The LeCun paradox — predicting with language while dismissing language predictors.
Type  theoretical (paradox identification and resolution)
Strength  theoretical argument

LeCun (2022) proposes the JEPA (Joint Embedding Predictive Architecture) framework for autonomous machine intelligence, arguing that world models should be learned from sensory experience rather than text. LeCun's position treats language as downstream of the perceptual substrate — useful for reasoning but not constitutive of the architecture itself. The position is clear: animals build world models without text; therefore text is not necessary for world models; therefore training on text is a "crutch" compared to learning from sensory experience.

The paradox: LeCun's own architecture includes a Configurator module that "modulates the behavior of all other modules" by setting goals, configuring predictions, and adjusting attention. In organizational domains, these functions — goal-setting, prediction-configuring, attention-adjusting — are performed through linguistic acts (strategic plans, policy declarations, reporting requirements). The Configurator that LeCun describes is, in organizational domains, a linguistically constituted module. He is describing a world model component that requires the linguistic infrastructure he dismisses.

The resolution is not that LeCun is wrong but that his argument has a domain boundary. For physical-world prediction (catching a ball, navigating terrain, recognizing objects), language is indeed unnecessary — animals demonstrate this. For organizational governance (setting policy, delegating authority, constituting constraints, declaring purpose), language is constitutive — the governance structures do not exist without the linguistic acts that create them. The animal-substrate argument fails for organizational domains because animal governance is fixed (genetically channeled pack hierarchies, colony roles) while human organizational governance is mutable (constituted and changed through speech acts). The mutable-institutional-reality argument permanently resolves the "animals have world models without language" objection for organizational domains.

Figure 3The LeCun paradox resolves through domain distinction: JEPA works for physical domains; organizational domains require the linguistic layer
Figure 3. The LeCun paradox resolves through domain distinction: JEPA works for physical domains; organizational domains require the linguistic layer.
F5
Vygotsky established that thought is linguistically structured — inner speech is the medium of deliberative cognition.
Type  convergent (developmental psychology + philosophy of mind)
Strength  theoretical argument (Vygotsky foundational; Carruthers provides contemporary extension)

Vygotsky (1934/1986) argued in Thought and Language that speech and thought are initially separate systems that merge around age three: thought becomes verbal, and speech becomes representational. Language development follows three stages: social speech (communication), private speech (self-directed talk), and inner speech (silent internal thought). Inner speech — highly condensed, symbolic, self-directed — is not merely the silent version of external speech but a distinct cognitive tool for planning, organizing, and problem-solving. Vygotsky's claim: language is not just a vehicle for expressing thought; thought comes into existence through language.

Carruthers (2002) extended this in Behavioral and Brain Sciences, arguing that language serves cognitive functions beyond communication: it enables explicit reasoning, conscious planning, and metacognition. The cognitive function of language is distinct from its communicative function — we think in language, not just speak in language.

The governance implication: organizational decision-making — weighing alternatives, considering constraints, formulating intent, committing to courses of action — is linguistically structured cognition. Decision-makers deliberate in language. They formulate plans in language. They communicate rationale in language. The internal cognitive process and the external governance act are both linguistic. This means that governance infrastructure must be linguistically compatible — it must operate at the linguistic level where governance cognition occurs.

F6
The extended mind thesis establishes that cognitive processes extend beyond the brain — LLMs are the natural cognitive extension for linguistic processing.
Type  convergent (philosophy of mind + cognitive science + media theory)
Strength  theoretical argument (Clark & Chalmers highly cited; Hutchins empirically grounded; Ong historically validated)

Clark & Chalmers (1998) argued in Analysis that cognitive processes can extend beyond the biological brain into the environment. Their "parity principle": if a part of the world functions as a process which, were it done in the head, we would recognize as cognitive, then that part of the world IS part of the cognitive process. The Otto-Inga thought experiment: Otto (Alzheimer's patient) uses a notebook as external memory; Inga uses biological memory. If the notebook functions as memory (reliable, accessible, endorsed), it IS Otto's memory — the cognitive process extends beyond the brain.

Hutchins (1995) demonstrated in Cognition in the Wild that cognition in real organizational settings (ship navigation) is distributed across individuals and artifacts — cognitive processes are properties of systems, not just brains. Ong (1982) showed in Orality and Literacy that writing technology restructured human consciousness — literacy didn't just record oral thought but created new cognitive capacities (abstract categorization, logical reasoning, historical consciousness).

The LLM implication: if writing extended cognitive memory (Ong), and if external artifacts can be genuine parts of cognitive processes (Clark & Chalmers), and if organizational cognition is distributed across people and tools (Hutchins), then LLMs are the natural next extension of linguistic cognitive processing. LLMs extend the human capacity for linguistic pattern processing — composition, analogy, cross-domain connection, reformulation — beyond individual cognitive bandwidth. They are not AI replacing human cognition; they are linguistic infrastructure amplifying it, in the same lineage as writing, printing, and computing.

F7
Language's role in the world model architecture is not uniform — it is irreducible for some ingredients, beneficial for others, and unnecessary for the rest.
Type  theoretical (original framework construction)
Strength  theoretical argument (synthesis across Austin, Searle, Hockett, Vygotsky, Clark & Chalmers)

Three categories emerge from mapping language's constitutive role against world model ingredients:

Irreducible (cannot exist without linguistic constitution in organizational domains):<br>- Relational governance structure: The relationships between organizational roles, authority chains, and accountability structures are constituted through declarations, appointments, charters, and contracts. Without linguistic acts, the relational structure does not exist. (Searle's status function declarations; Winograd & Flores's conversations for action.)<br>- Normative constraints: Organizational rules, policies, and prohibitions are constituted through linguistic acts. A regulation IS a linguistic declaration with deontic force. Without the linguistic act, the constraint has no existence. (Searle's constitutive rules; Austin's performatives.)<br>- Declared organizational purpose: Mission statements, strategic objectives, and organizational goals are constituted through linguistic acts. Purpose in organizational domains is declared, not observed. (Searle's status function declarations.)

Beneficial but not irreducible (function better with linguistic support but can exist without it):<br>- Entity identity: Naming and classification are linguistic, but entities can exist pre-linguistically.<br>- Transition logic: Rules of change are often linguistically encoded but can be observed from behavioral patterns.<br>- Observation: Directed attention is linguistically guided but perception is pre-linguistic.<br>- Uncertainty: Risk assessment and uncertainty quantification use language but the phenomenon is pre-linguistic.

Unnecessary (exist independently of language):<br>- Distinctions: Boundary-drawing can be perceptual, not linguistic.<br>- Time: Temporal ordering is pre-linguistic.<br>- Memory-as-storage: Retention occurs in neural and physical substrates without language.

This three-category mapping is the sprint's core deliverable. It resolves the binary (language models vs. world models) by showing that language is architecturally irreducible for some world model ingredients and unnecessary for others — the answer depends on the domain and the ingredient.

F8
The mutable-institutional-reality argument permanently resolves the evolutionary priority objection for organizational domains.
Type  theoretical (argument construction)
Strength  theoretical argument

The strongest objection to language irreducibility is evolutionary: animals build world models without language; therefore language is not necessary for world models; therefore dismissing language models as "world models" is justified. The mutable-institutional-reality argument resolves this:

Animals have governance. Wolf packs have hierarchy. Bee colonies have role differentiation. Primate groups have dominance structures. But animal governance is fixed — embedded in instinct, genetically channeled, not constituted through declaration. No animal can change its governance structure by declaring new rules. Only humans can constitute, modify, contest, and replace governance structures through speech acts. This is not a difference of degree (humans are smarter about governance) but of kind (human governance is linguistically constituted; animal governance is not).

Therefore: the evolutionary priority objection is correct for physical-world prediction (animals demonstrate world models without language) and incorrect for organizational governance (mutable institutional reality requires language). The field's binary — "language models are not world models" — is true for the physical domain LeCun targets and false for the organizational domain where governance structures are linguistically constituted.

§4Scope + Limitations

Included: Speech act theory (Austin, Searle), linguistic design features (Hockett, HCF), cognitive science of language (Vygotsky, Carruthers), extended mind/distributed cognition (Clark & Chalmers, Hutchins, Ong), organizational language/action (Winograd & Flores), world model architecture (LeCun), evolutionary linguistics (Deacon, Tomasello).

Date range: 1934 (Vygotsky) — 2022 (LeCun)

Excluded: Formal linguistics (generative grammar, minimalist program) beyond HCF — the argument does not depend on specific linguistic theory. Computational NLP (transformer architecture, attention mechanisms) — the argument is about language's constitutive role, not its processing mechanisms. Chomsky-Everett debate on recursion universality — the argument requires only that human language is an open generative system, not that recursion is the sole mechanism.

Known gaps:
Confidence:

§5Research Synthesis

C1
Language is architecturally irreducible for organizational world models — three ingredients require linguistic constitution.
Confidence  strongly supported
Based on  F1, F2, F3, F7

Relational governance structure, normative constraints, and declared organizational purpose are constituted through speech acts. They have no existence independent of the linguistic acts that create them. This is the permanent answer to the field's binary: language models are not world models (correct for physical domains), but world models for organizational domains require language (because organizational reality is linguistically constituted).

C2
The evolutionary priority objection ("animals have world models without language") is domain-limited.
Confidence  strongly supported
Based on  F1, F4, F8

Correct for fixed governance (pack hierarchy, colony roles). Incorrect for mutable governance (organizational structures constituted and changed through speech acts). Only humans can change governance through declaration. Organizational domains have mutable governance. Therefore language is irreducible for organizational world models.

C3
The LeCun paradox resolves through domain distinction, not dismissal.
Confidence  strongly supported
Based on  F4

LeCun is correct that physical-world prediction doesn't require language. The paradox arises when he describes world model components (configurators, goal-setters) that in organizational domains are linguistically constituted. The resolution: JEPA works for physical domains; organizational domains require the linguistic layer that JEPA's architecture dismisses.

C4
The speech act tradition (Austin → Searle → Winograd & Flores) is the direct intellectual ancestor of governance infrastructure.
Confidence  strongly supported
Based on  F2, F3

Performative utterances constitute governance reality. "X counts as Y in C" is the formula for institutional facts. Conversations for action constitute organizational coordination. The lineage from speech act theory to governance substrate design is direct and unbroken.

C5
LLMs are cognitive infrastructure extending linguistic processing, in the lineage of writing, printing, and computing.
Confidence  strongly supported
Based on  F5, F6

The extended mind thesis, distributed cognition, and the history of cognitive technology establish that cognitive processes extend beyond the brain through tools. LLMs are the natural next extension for linguistic processing — not replacing governance cognition but amplifying it.

§6Open Questions

Questions carried forward to the open-question registry
1
Can the three-category ingredient mapping be empirically validated?
2
How does Brandom's inferentialism relate to the constitutive role of language?
3
What is the relationship between formal governance (constituted through speech acts) and informal governance (constituted through practice, habit, culture)?

§7Citations & Provenance

Philosophy of Language & Speech Acts
1. Austin, J. L. (1962). How to Do Things with Words. Oxford University Press. (William James Lectures, Harvard 1955.)
2. Searle, J. R. (1969). Speech Acts: An Essay in the Philosophy of Language. Cambridge University Press.
3. Searle, J. R. (1995). The Construction of Social Reality. Free Press.
4. Searle, J. R. (2010). Making the Social World: The Structure of Human Civilization. Oxford University Press.
5. Winograd, T. & Flores, F. (1986). Understanding Computers and Cognition: A New Foundation for Design. Ablex.
Linguistics & Language Evolution
6. Hockett, C. F. (1960). "The Origin of Speech." Scientific American, 203(3), 88–97.
7. Hauser, M. D., Chomsky, N. & Fitch, W. T. (2002). "The Faculty of Language: What Is It, Who Has It, and How Did It Evolve?" Science, 298, 1569–1579.
8. Tomasello, M. (2008). Origins of Human Communication. MIT Press.
9. Deacon, T. W. (1997). The Symbolic Species: The Co-evolution of Language and the Brain. Norton.
Cognitive Science & Inner Speech
10. Vygotsky, L. S. (1934/1986). Thought and Language. MIT Press. (Trans. A. Kozulin.)
11. Carruthers, P. (2002). "The Cognitive Functions of Language." Behavioral and Brain Sciences, 25(6), 657–674.
Extended Mind & Distributed Cognition
12. Clark, A. & Chalmers, D. (1998). "The Extended Mind." Analysis, 58(1), 7–19.
13. Hutchins, E. (1995). Cognition in the Wild. MIT Press.
14. Ong, W. J. (1982). Orality and Literacy: The Technologizing of the Word. Methuen.
World Model Architecture
15. LeCun, Y. (2022). "A Path Towards Autonomous Machine Intelligence." Open review.
Cite As

Smith, C. (2026). Language, Cognition & World Models: Why the Linguistic Layer Is Irreducible (Research Report RR-019, WMI Thesis). GrytLabs Research Institute. https://doi.org/10.5281/zenodo.20236831

© 2026 GrytLabs Dynamics Inc. Licensed under CC-BY 4.0.

Research Ethics Statement

This research is conducted under the GrytLabs Research Code of Ethics, derived from the IIA Code of Ethics and the GAO Yellow Book ethical framework, adapted for a research-institute context.

Four principles govern all research activity:

Integrity — findings are reported as found, not as convenient. Unfavorable results are published with the same rigor as favorable ones.

Objectivity — research questions are framed to be falsifiable. Conflicts of interest (including the founder's dual role as researcher and patent holder) are disclosed, not resolved by assertion.

Confidentiality — disclosure levels (L0–L3) govern what appears in public research. Embargoed findings, IP-critical details, and pre-publication material are withheld per the Disclosure Discipline (GOV-PS-006), not suppressed.

Competency — claims are bounded by the evidence that supports them. Architectural claims cite spec sections. Empirical claims cite research artifacts. Claims that exceed available evidence are flagged as open questions, not presented as conclusions.

The Executive Director is a Certified Internal Auditor (CIA), Institute of Internal Auditors, personally bound by the IIA Code of Ethics as a condition of that credential. This is a personal attestation, not an institutional conformance claim — GrytLabs has not undergone an IIA Quality Assessment Review and does not claim IPPF conformance.

The governing traditions (IIA, GAO, AICPA, COSO) are formally mapped to the operating model in GOV-PS-001. This research applies the principles those traditions codify; it does not claim endorsement, review, or certification by any standards body.

Publication Notice

Disclaimer

This publication is provided for research and informational purposes. GrytLabs makes reasonable efforts to ensure accuracy but does not warrant that this publication is free of errors or omissions.

If you believe this publication contains errors, omissions, or misattributions, please contact the lab at research@grytlabs.ai. Corrections will be acknowledged in subsequent versions.

AI-Assisted Research Statement

This work was produced through AI-assistive collaboration under GrytLabs' AI-assistive collaboration disclosure protocol. Claude (Anthropic) participated in literature synthesis, cross-domain pattern identification, and argumentation structuring. OpenAI Codex participated in citation and accuracy verification. AI actors participate with delegated authority, never inherent authority. Responsibility for all findings, claims, and conclusions rests with the named author.

Provenance

Full workpaper with attestation and provenance chain available at research.grytlabs.ai/docs. DOI: 10.5281/zenodo.20236831