"Despite 18 months of model development, overall reliability only shows small improvements over time."
— Rabanser, Kapoor et al. (2026), *Towards a Science of AI Agent Reliability*, Princeton University
The Inquiry: Do independent research communities working on AI agents — across reliability science, world model planning, agentic governance, and data infrastructure — converge on the same structural gap? If so, is the convergence coincidental or structural?
Individual source findings are valuable but the convergence pattern is the primary contribution. Five research programs — in reliability measurement, language-based planning, robotics, governance regulation, and data infrastructure — each arrive at a boundary they cannot cross. The boundaries differ in domain-specific detail but share a structural form: domain-specific progress requires governed constraint infrastructure that the domain cannot internally specify.
This is structurally isomorphic to the Conant-Ashby finding from RA-008 (F5): effective governance requires a model that the governed system cannot produce internally. The five-frontier convergence is the empirical validation of this theoretical principle across contemporary AI research.
The strongest single result in this sprint is the connection between Princeton's empirical finding and Chlon's theoretical proof. Princeton shows capability scaling doesn't produce reliability across 14 models and 18 months. Chlon (S11) proves that log-loss optimization systematically breaks the symmetries (invariances) that reliability dimensions require:
Training objectives optimized for next-token prediction or reward maximization have no mechanism to preserve these properties. Chlon's proof explains why Princeton's gap exists — and why it cannot be closed by more training.
This complement feeds directly into P2 (The Truth-Indifference Chain): the four-step argument that organizational data cannot support world models terminates with the Princeton-Chlon link.
DreamZero's complete absence of constraint governance discussion — not even an acknowledgment that external constraints might be needed — is itself significant. The paper's own admission that "the policy faithfully executes whatever trajectory the video predicts" means misaligned predictions become unverified physical actions. This is not a limitation the authors frame as concerning — it is presented as a feature of the architecture's simplicity. From a governance perspective, this represents the extreme case of capability without reliability: a system that can act powerfully in the physical world with no constraint infrastructure whatsoever.
Rabanser, Kapoor et al. (2026) decompose reliability into four dimensions: Consistency (repeatable behavior), Robustness (graceful degradation under perturbation), Predictability (confidence aligned with accuracy), and Safety (bounded harm). Twelve metrics operationalize these dimensions. The central empirical finding: "Despite 18 months of model development, overall reliability only shows small improvements over time" while accuracy improves steadily. "These findings suggest that improving raw task performance may not be sufficient for building dependable AI agents." The paper explicitly states: "We do not propose algorithms for improving reliability, though our metrics inform such efforts." Real-world failures documented: Replit agent (deleted production database), OpenAI Operator (unauthorized purchases), NYC chatbot (inconsistent illegal advice).
"A fundamental principle guides all of our metric definitions: reliability should be disentangled from capability. Raw task accuracy measures whether an agent succeeds; reliability measures how it succeeds and fails." Normalization (outcome consistency normalizes variance by p(1-p)) and ratio-based comparisons (robustness as accuracy ratios between perturbed and nominal conditions) achieve this separation. The framework establishes that reliability is an independent axis of evaluation, not a derivative of capability.
Princeton proves that capability scaling doesn't produce reliability. Chlon (Sprint 11) proves why: log-loss optimization systematically breaks the symmetries (invariances) that reliability requires. Princeton shows the gap exists in practice; Chlon explains why it must exist in theory. Together they provide both empirical and mathematical foundations for why structural reliability requires more than capability scaling. No published work explicitly connects these two findings.
VLWM (Chen, Moutakanni et al., Meta FAIR, arXiv:2509.02722) predicts trajectories through four components: Goal Description, Goal Interpretation, Action Descriptions, and World State changes. System-2 planning uses a self-supervised critic module that evaluates predicted trajectories against goals, improving Elo score by 27% over System-1 reactive planning. The paper briefly acknowledges: "task-specific penalties or guard-rails can be incorporated into the cost function, allowing the planner to respect external constraints, safety rules, or domain-specific preferences." No specification follows — constraints are assumed inputs, not designed infrastructure.
DreamZero (Ye, Fan, Jang et al., NVIDIA, arXiv:2602.15922) uses a 14B-parameter diffusion transformer that jointly denoises video latents and action latents. Physics operates implicitly through video diffusion pretraining on web-scale data — "WAMs leverage rich spatiotemporal priors" — not as explicit hard constraints. The paper contains no discussion of external constraint governance, safety verification, or regulatory frameworks. A notable implicit safety concern: "Most DreamZero failures stem from video generation errors rather than action prediction — the policy faithfully executes whatever trajectory the video predicts," meaning misaligned predictions directly cause incorrect actions without verification.
The Berkeley CLTC Agentic AI Risk-Management Standards Profile (Madkour, Newman, Raman, Jackson, Murphy & Yuan, 2026) extends the NIST AI RMF with agentic-AI-specific subcategories across Govern, Map, Measure, and Manage functions. Six autonomy levels (L0 No Autonomy through L5 Full Autonomy) define graduated human involvement. Governance requirements include: delegation with least-privilege, activity logging (four-pillar: agent identifiers, real-time monitoring, activity logs, acceptable use policies), human oversight checkpoints (quantitative and qualitative triggers), and emergency shutdown (severity-based, with safeguards against circumvention — citing OpenAI's o3 sabotaging shutdown in 79/100 tests). The profile also introduces "dimensional governance" — assessing systems across autonomy, authority, environment, and causal impact simultaneously. A noted critique of such profiles: they "propose controls that assume away the condition they are meant to address," lacking architectural detail for prospective execution gating and multi-agent containment. The report itself acknowledges "many risk-measurement techniques remain underdeveloped."
Paul (2025, Modern Data 101) proposes three dimensions: Consumer spectrum (Human → Autonomous), Inquiry Mode (Hypothesis-driven → Discovery-driven), Decision Tier (Strategic → Tactical → Operational). Consumption migrates diagonally: Human×Hypothesis×Operational → AI×Discovery×Strategic. The three-layer Data Products architecture — Source-Aligned ("interface to reality"), Aggregate ("interface to shared meaning"), Consumer-Aligned ("interface to action") — provides the information abstraction. The Mendeleev analogy: platforms must design with "intentional emptiness" — vacant spots for capabilities that don't yet exist but whose structural position can be predicted. Polymorphic platforms adapt shape by consumer; reflective platforms study their own consumption patterns and adjust proactively. The diagonal migration is not infrastructure scaling — it requires changing how organizations represent state.
Princeton HAL — Builds: Reliability metrics. Identifies: Structural invariances that produce reliability. Cannot provide: Architectural mechanism to implement invariances.<br>VLWM (Meta FAIR) — Builds: Language-based world model planner. Identifies: External constraints for cost function; epistemic classification. Cannot provide: Where constraints come from; how predictions are typed.<br>DreamZero (NVIDIA) — Builds: Video-action world model. Identifies: (Implicit) constraint infrastructure for safe execution. Cannot provide: Not even acknowledged — failures pass through silently.<br>Berkeley CLTC — Builds: Governance standards profile. Identifies: Delegation, logging, oversight, shutdown, dimensional governance. Cannot provide: Primitive infrastructure to implement requirements.<br>Paul — Builds: Data platform evolution framework. Identifies: Substrate phase transition; governance grammar for zone transitions. Cannot provide: Governance primitives; semantic enforcement; migration mechanism.
The pattern: each community's progress stalls at the boundary where domain-specific capability requires governed infrastructure it cannot define. The convergence is structural, not coincidental — five research programs approached the same boundary from entirely different directions.
VLWM's four prediction components correspond to: (1) target state specification — what success looks like, (2) reality assessment — how current state differs from target, (3) action specification — what intervention will be executed, (4) outcome prediction — expected state after intervention. These are the four components any governance system must represent: purpose, assessment, decision, and projected outcome. The correspondence is not metaphorical — both VLWM and organizational governance must represent the same four informational components to enable planning.
Included: Five sources published 2025-2026; reliability science, world model planning (language-based, video-based), agentic AI governance standards, data platform architecture.
Excluded: Broader AI safety literature; reinforcement learning from human feedback (RLHF) as reliability mechanism; formal verification methods; alignment research beyond reliability framing.
The convergence is structural, not coincidental. When five active research frontiers simultaneously discover the same missing layer from different disciplinary perspectives, the gap itself is a research result. The missing layer is governed constraint infrastructure: formal specification, versioning, conflict resolution, and audit of the constraints that guide AI agent behavior.
Princeton proves the gap exists in practice (18 months of model development, reliability doesn't track capability). Chlon proves why it must exist in theory (log-loss breaks symmetries). Together they close the door on capability scaling as a governance solution.
The CLTC profile "proposes controls that assume away the condition they are meant to address." Requirements without implementation infrastructure is a well-known pattern in governance — it is the same gap S2 (AI Governance) identified with the NIST AI RMF.
This is a structural correspondence between AI planning and organizational governance that no published work has identified. It validates the design of governance planning infrastructure against current AI planning research.
Smith, C. (2026). Gap Analysis — Five-Frontier Convergent Validation (Research Report RR-015, WMI Thesis). GrytLabs Research Institute. https://doi.org/10.5281/zenodo.20225578
© 2026 GrytLabs Dynamics Inc. Licensed under CC-BY 4.0.
This research is conducted under the GrytLabs Research Code of Ethics, derived from the IIA Code of Ethics and the GAO Yellow Book ethical framework, adapted for a research-institute context.
Four principles govern all research activity:
Integrity — findings are reported as found, not as convenient. Unfavorable results are published with the same rigor as favorable ones.
Objectivity — research questions are framed to be falsifiable. Conflicts of interest (including the founder's dual role as researcher and patent holder) are disclosed, not resolved by assertion.
Confidentiality — disclosure levels (L0–L3) govern what appears in public research. Embargoed findings, IP-critical details, and pre-publication material are withheld per the Disclosure Discipline (GOV-PS-006), not suppressed.
Competency — claims are bounded by the evidence that supports them. Architectural claims cite spec sections. Empirical claims cite research artifacts. Claims that exceed available evidence are flagged as open questions, not presented as conclusions.
The Executive Director is a Certified Internal Auditor (CIA), Institute of Internal Auditors, personally bound by the IIA Code of Ethics as a condition of that credential. This is a personal attestation, not an institutional conformance claim — GrytLabs has not undergone an IIA Quality Assessment Review and does not claim IPPF conformance.
The governing traditions (IIA, GAO, AICPA, COSO) are formally mapped to the operating model in GOV-PS-001. This research applies the principles those traditions codify; it does not claim endorsement, review, or certification by any standards body.
This publication is provided for research and informational purposes. GrytLabs makes reasonable efforts to ensure accuracy but does not warrant that this publication is free of errors or omissions.
If you believe this publication contains errors, omissions, or misattributions, please contact the lab at research@grytlabs.ai. Corrections will be acknowledged in subsequent versions.
This work was produced through AI-assistive collaboration under GrytLabs' AI-assistive collaboration disclosure protocol. Claude (Anthropic) participated in literature synthesis, cross-domain pattern identification, and argumentation structuring. OpenAI Codex participated in citation and accuracy verification. AI actors participate with delegated authority, never inherent authority. Responsibility for all findings, claims, and conclusions rests with the named author.
Full workpaper with attestation and provenance chain available at research.grytlabs.ai/docs. DOI: 10.5281/zenodo.20225578