RA-018 · Research Report · 2026-05-16 · DOI 10.5281/zenodo.20237089

Neurosymbolic AI, Hybrid Architectures & the Three Mechanisms

Cameisha Smith

The Inquiry

The Inquiry: Has the neurosymbolic AI field — in three decades of research on the "integration question" (how to combine neural and symbolic systems) — identified, named, or formalized what we call Constitution as a distinct mechanism of model creation co-equal with training? And does training-based optimization conflate statistical rarity with structural prohibition in a way that no training regime can resolve?

The neurosymbolic AI tradition (Garcez & Lamb 2023, Marcus 2020, Kautz 2022) has produced a rich taxonomy of integration architectures — from loose coupling (Type 2: Symbolic[Neuro]) to deep embedding (Type 6: Neuro[Symbolic]). Yet all six types in Kautz's taxonomy assume integration of two components within a single system. The ontology engineering tradition (Gruber 1993, Guarino 1998) has been specifying constitutive constraints — what can meaningfully exist in a domain — for three decades, without recognizing this activity as a mechanism of model creation co-equal with training. If neither tradition has named this mechanism, then a three-mechanism taxonomy (Training, Constitution, Accretion) is a genuine contribution. If one has, the contribution shifts to integrating existing concepts under a unifying framework.

Falsifiable formulation: The thesis is falsifiable: if the NeSy literature contains a named concept equivalent to Constitution-as-mechanism, the novelty claim fails. If the rarity/prohibition conflation has been identified and resolved within training-based approaches, the architectural argument for a separate constitutional mechanism weakens.

Executive Summary

The integration question vs. the mechanism question. The NeSy field's 30-year organizing question — "how do we combine neural and symbolic?" — has produced valuable architectures (F1, F3, F5) and compelling arguments for hybrid systems (F2). But the question itself presupposes that there are two things to be combined. The mechanism question — "how do models come into existence?" — reveals three distinct processes (F13), each with different temporal character (F15), different structural guarantees, and different coverage of what a complete world model requires. The NeSy tradition has been answering the wrong question — not a bad question, but an incomplete one.

![Figure 1. The integration question produces an architecture taxonomy (top). The mechanism question produces a creation taxonomy (bottom).](images/rr-018-fig-01.png)

Constitution as unnamed practice. The most striking finding is F8: the practice of Constitution has existed for 30 years under the name "ontology engineering." Gruber (1993) defined the core act — explicit specification of a conceptualization (F6). Guarino (1998) formalized the key property — ontological commitments as constitutive constraints (F7). But neither recognized this as a mechanism of model creation co-equal with training. The ontology engineering community treats specification as knowledge representation — a way of encoding what you already know. The mechanism perspective treats it differently: Constitution is how structural constraints come into existence. It's not encoding existing knowledge; it's creating the structures that define what knowledge can exist.

This finding resolves SCT-C01 in a nuanced way: Constitution-as-practice has been named (it's called ontology engineering). Constitution-as-mechanism has not. The novelty is the mechanism recognition, not the practice. This is analogous to how Deming didn't invent manufacturing inspection — he recognized it as a mechanism with specific properties and limitations, enabling the shift to quality-by-design. The three-mechanisms taxonomy does for knowledge creation what Deming did for quality: it recognizes that the mode of creation determines the properties of the output.

The rarity/prohibition argument. F9 through F12 establish the sprint's strongest novel contribution. Training cannot distinguish between statistical rarity and structural prohibition because both manifest as low-probability regions in the loss landscape. This is not a limitation of current models — it is intrinsic to what training is (optimizing a loss function over observed data). Constitutional uncertainty (F10, F18) — the uncertainty about whether a low-probability observation represents genuine rarity or structural impossibility — is resolvable only by specification, not by observation. Yuenyong's (2025) counter-argument (F12) — that LLMs can learn everything ontologies specify — fails precisely at this boundary: LLMs can learn that negative-time-duration transactions never appear in data, but they cannot learn that such transactions are structurally prohibited as opposed to merely unobserved.

The established epistemic/aleatoric dichotomy (F18) does not capture this. Epistemic uncertainty is about what the modeler doesn't know. Aleatoric uncertainty is about inherent randomness. Constitutional uncertainty is about structural constraints on what can exist — a domain property, not a modeler property or a random process property.

![Figure 2. Training-based optimization conflates rarity with prohibition — both are low-probability regions in the loss landscape.](images/rr-018-fig-02.png)

Accretion as the invisible mechanism. F14 establishes that Accretion has no NeSy equivalent. The NeSy field sees neural (Training) and symbolic (Constitution-as-component) but not operational accumulation (Accretion). This is because NeSy studies system architecture, not organizational knowledge lifecycle. The organizational memory literature (Walsh & Ungson 1991, Nonaka & Takeuchi 1995 — engaged in prior sprints S3 and S14) has studied what we call Accretion extensively but has not named it as a mechanism of model creation. The three-mechanisms taxonomy bridges these fields by recognizing Accretion as a third mechanism alongside Training and Constitution.

SAI as validation. Goldfeder/Wyder/LeCun (2026) validate the composed-systems thesis (F16) and the MILA workshop (F17) suggests growing interest in modular, specialized architectures. But neither addresses the governance question: how do you coordinate specialized modules? Who decides authority? How do you prevent incoherent joint behavior? SAI provides the existence proof for the gap — composed systems need coordination, and training alone cannot provide coordination guarantees. This is where Constitutional structure (authority hierarchies, constraint propagation, accountability chains) becomes architecturally necessary, not just organizationally convenient.

Abstract

The neurosymbolic AI field has spent three decades on the integration question — how to combine neural and symbolic components within a single system. This sprint reframes the question as a mechanism question: how do models come into existence? Systematic review of the field's definitive surveys (Garcez & Lamb 2023, Kautz 2022, Marra et al. 2024, Hitzler & Sarker 2021) reveals no named concept equivalent to Constitution as a distinct mechanism of model creation co-equal with training. The ontology engineering tradition (Gruber 1993, Guarino 1998) has been performing Constitution for thirty years — specifying constitutive constraints that define what can meaningfully exist — without recognizing this as a mechanism. The sprint's strongest novel contribution is the rarity/prohibition indistinguishability claim: training-based optimization cannot distinguish between statistical rarity and structural prohibition because both manifest as low-probability regions in the loss landscape. This conflation is intrinsic to what training is, not a limitation of current models. Constitutional uncertainty — a third type alongside epistemic and aleatoric — is resolvable only by specification, not by observation.

"An ontology is an explicit specification of a conceptualization." — Gruber (1993), Knowledge Acquisition
Findings19
F-RA-018-01 · gap-identification · lab-originated
Garcez & Lamb (2023) define neurosymbolic AI as integrating "robust learning in neural networks with reasoning and explainability via symbolic representations," framing the field as a two-component integration problem; no concept equivalent to Constitution-as-mechanism or Accretion appears in this definitive 3rd-wave survey.
F-RA-018-02 · gap-identification · lab-originated
Marcus (2020) argues for "hybrid, knowledge-driven, reasoning-based" AI and identifies deep learning's insufficiency, but frames the solution as architectural integration, not mechanism separation; "rich prior knowledge" is the closest NeSy comes to naming Constitution's input, yet the question "how does rich prior knowledge come into existence?" is not asked.
F-RA-018-03 · gap-identification · lab-originated
Kautz (2022) proposed a six-type taxonomy of neurosymbolic integration architectures (Type 1 Symbolic→Neuro through Type 6 Neuro[Symbolic]), all assuming integration within a single system boundary; all six describe how components interact, none describes how the system's structural constraints come into existence.
F-RA-018-04 · gap-identification · lab-originated
Marra et al. (2024) identified seven shared dimensions between NeSy and StarAI (Statistical Relational AI), bridging probabilistic and neural-symbolic traditions, but all seven dimensions concern system properties, not creation mechanisms; dimension (4) "parameter vs. structure learning" asks "what does the system learn?" not "how does its foundational structure come into existence?"
F-RA-018-05 · gap-identification · lab-originated
Hitzler & Sarker (2021) provide a comprehensive reference volume categorizing NeSy research by topic (KR approaches, logic-based methods, neural theorem proving, concept learning, applications), confirming the field's organizing principle is integration architecture, not creation mechanism; the organizing question throughout is "how to combine" the two traditions.
F-RA-018-06 · theoretical-grounding · established
Gruber (1993) defined an ontology as "an explicit specification of a conceptualization" — the foundational definition of what the three-mechanisms taxonomy calls Constitution — but framed it as knowledge representation, not as a mechanism of model creation co-equal with learning.
F-RA-018-07 · theoretical-grounding · established
Guarino (1998) formalized ontological commitments as constitutive constraints — constraints that define what can exist in a domain (the K = <C, ℑ> pair), not merely what happens to be observed — distinguishing what a language can express (constitutive) from knowledge-base content (populating).
F-RA-018-08 · architectural-framing · lab-originated
The Gruber-Guarino lineage (1993–1998) establishes that the practice of Constitution exists and has existed for three decades, but it has never been framed as a mechanism of model creation, only as knowledge representation.
F-RA-018-09 · root-cause-diagnosis · lab-originated
Training-based optimization treats all low-probability regions identically — it cannot distinguish between events that are statistically rare and events that are structurally prohibited (a $10B nonprofit transaction vs. a negative-time-duration transaction both register as low-probability tails).
F-RA-018-10 · architectural-resolution-claim · lab-originated
The established epistemic/aleatoric uncertainty dichotomy does not capture structural prohibition; the sprint proposes "constitutional uncertainty" as a third type — uncertainty about whether a low-probability observation represents rarity or prohibition — resolvable only by specification (Constitution), not by observation (Training).
F-RA-018-11 · formal-establishment · lab-originated
The Hassana Labs (2026) preprint argues world models alone cannot achieve AGI, building on Chlon (2025a arXiv:2507.11768, 2025b arXiv:2509.11208) formal results that log-loss optimization breaks symmetries in learned representations — a result this report maps to governance invariances, providing mathematical grounding for the rarity/prohibition claim.
F-RA-018-12 · counter-position-rebuttal · lab-originated
Yuenyong (2025) argues LLMs make ontology engineering obsolete, but the argument fails specifically for constitutive constraints: LLMs cannot distinguish what is structurally prohibited from what is merely absent from training data.
F-RA-018-13 · architectural-framing · lab-originated
The NeSy tradition's organizing question ("how do we integrate neural and symbolic?") is an architecture question; the mechanism question ("how do models come into existence?") is a different question that produces a different taxonomy — three distinct modes: Training (episodic optimization; produces pattern recognition; cannot produce structural guarantees), Constitution (deliberate specification of what can exist; produces structural constraints; cannot produce content), Accretion (continuous operational accumulation; produces domain-specific knowledge; cannot produce structure).
F-RA-018-14 · gap-identification · lab-originated
Accretion has no equivalent in the neurosymbolic tradition — the NeSy field sees two components (neural/symbolic) but not three mechanisms (Training/Constitution/Accretion); the organizational memory literature (Walsh & Ungson 1991, Nonaka & Takeuchi 1995, Argote 2013) has studied Accretion extensively but not named it as a mechanism of model creation.
F-RA-018-15 · architectural-framing · lab-originated
The three mechanisms have fundamentally different temporal characters — episodic (Training: train/deploy/retrain), rare (Constitution: defines the structural frame, changes only at architectural events), continuous (Accretion: every operational interaction potentially adds knowledge) — which explains why integration architectures (Kautz Types 1–6) cannot represent them within a single temporal frame.
F-RA-018-16 · gap-identification · lab-originated
Goldfeder, Wyder & LeCun (2026) argue for Superhuman Adaptable Intelligence (SAI) — specialization over generality — validating the composed-systems thesis (world models are composed, not monolithic) without providing a coordination protocol; the paper leaves unanswered how to govern interactions between specialized modules, who decides module authority, and how to prevent incoherent joint behavior.
F-RA-018-17 · gap-identification · lab-originated
The MILA World Modeling Workshop (Feb 4–6, 2026; LeCun, Bengio, Schmidhuber and others) focused on scalable architectures, representation learning, multimodal integration, and computational foundations; the governance question (coordinating world-model components under authority with accountability) was not a workshop theme.
F-RA-018-18 · architectural-framing · lab-originated
The established uncertainty literature recognizes ontological uncertainty as a third category beyond epistemic and aleatoric (per the Helmholtz UQ Dictionary: "unconscious utilization of inappropriate methodology or belief systems"), but frames it as modeler deficiency, not as a structural domain property.
F-RA-018-21 · convergent-validation · lab-originated
The three-mechanisms taxonomy is convergent with and triangulated by three prior sprints: S5 (Semantic Web & KR — SHACL/OWL/Description Logics as the Constitution toolchain), S8 (World Models — where the three mechanisms were first articulated, on a Conant-Ashby control-theoretic foundation), and S11 (Symmetry & Invariance — Chlon's log-loss/symmetry-breaking results as the mathematical grounding for the rarity/prohibition claim). The NeSy field validation confirms the mechanisms are not already named in the tradition.
Open Questions6
OQ-070Can the rarity/prohibition indistinguishability be empirically demonstrated?
OQ-071Does Bengio have published work on a third uncertainty type?
OQ-072What is the exact publication venue for Chlon (2026)?
OQ-073Does NeSy "neurosymbolic governance" constitute a near-miss?
OQ-074Does SCT-H02 survive NeSy engagement?
OQ-075How does AuditMAI infrastructure connect to three-mechanisms taxonomy?
Bibliography14
Garcez, Artur d'Avila and Lamb, Lu{\'\i}s C. (2023) · Neurosymbolic {AI}: The 3rd Wave
Marcus, Gary (2020) · The Next Decade in {AI}: Four Steps Towards Robust Artificial Intelligence
Kautz, Henry (2022) · The Third {AI} Summer: {AAAI} Robert S. Engelmore Memorial Lecture
Marra, Giuseppe and Duman{\v{c}}i{\'c}, Sebastijan and Manhaeve, Robin and De Raedt, Luc (2024) · From Statistical Relational to Neurosymbolic Artificial Intelligence: A Survey
(2021) · Neuro-Symbolic Artificial Intelligence: The State of the Art
Gruber, Thomas R. (1993) · A Translation Approach to Portable Ontology Specifications
Guarino, Nicola (1998) · Formal Ontology and Information Systems
Goldfeder, Ari and Wyder, Simon and LeCun, Yann and Shwartz-Ziv, Ravid (2026) · {AI} Must Embrace Specialization via {SAI}
(2026) · Understanding World Models Workshop
{Helmholtz AI} (2024) · Uncertainty Quantification Dictionary
H{\"u}llermeier, Eyke and Waegeman, Willem (2021) · Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methods
Der Kiureghian, Armen and Ditlevsen, Ove (2009) · Aleatory or Epistemic? {Does} It Matter?
+2 more citations