Context as Constraint: Why RAG Fails Construction
Back to Articles
Constraints

Context as Constraint: Why RAG Fails Construction

The AI industry optimized search over unstructured data. We built a structured ontology and knowledge graph for construction operations instead.

Rynalty Group
March 12, 2026
12 min read
Share:

The Video That Said the Quiet Part Out Loud

A recent video making the rounds in the AI engineering community lays out a thesis that anyone building operational AI should hear: Most AI agents treat every question like a search. This is an error.

The speaker traces the full arc of RAG (Retrieval-Augmented Generation) development — from embedding spaces and vector search to chunk optimization, retrieval reranking, and the explosion of 17,000+ academic papers all trying to solve the same problem: How do I get the right pieces of hay from this haystack?

His conclusion? All of that work is trying to patch an unstructured data problem. A problem that is "particularly well suited for expert knowledge modeling via ontologies and knowledge graphs."

We watched that video and thought: That's what we built.

What RAG Gets Wrong in Construction

Let's ground this in reality. When a project manager on a data center build asks, "What's the status on the Unit 3 hydronic piping?" — what happens in a RAG-based system?

The system searches for chunks of text that mention 'Unit 3' and 'hydronic piping.' It might find a daily report from two weeks ago. It might find a submittal log entry. It might find an email thread about a material substitution. It retrieves them, ranks them, and feeds them to the LLM.

The problem? Without structure, the system doesn't know that the submittal was rejected, that the material substitution affects the installation sequence, that the crew scheduled for next Tuesday is certified for the original spec but not the substitute, or that the delay on Unit 3 triggers a liquidated damages clause in the subcontract.

RAG found the hay. But it doesn't understand the barn.

This is what the speaker means by 'chunks store facts, concepts give them meaning.' Construction doesn't need more facts. It needs structured relationships between facts — the ontology that says this submittal connects to this spec, which drives this work package, which is assigned to this crew, which is governed by this contract clause.

The Ontology We Already Built

In Ontology as Constraint, we described the Eleven-Reality Problem: a single construction project requires at least eleven distinct professional perspectives — Field Foreman, QC Inspector, Project Manager, Estimator, Submittals Coordinator, Closeout Administrator, Scheduler, Shop Manager, Procurement Manager, Safety Director, and Owner/Principal. Each one operates with a different mental model of the same project.

RAG treats these eleven realities as a retrieval problem. Search across all the documents and hope the right context surfaces. But the speaker in this video nails why that fails: "Bringing in too much fluff and you drown out the answer. Bring in mismatched data and the LLM hallucinates."

Groundline took the opposite approach. We built 18 domain tables — schedules, work packages, submittals, RFIs, procurement, contracts, crews, inspections, materials, safety incidents, change orders, and more — and connected them through a Unified Events Stream. This is not a search index. It is a structured ontology instantiated as a knowledge graph.

Every signal that enters the system — a daily report, a forwarded email, a PDF schedule upload, a field observation — is normalized into this shared structure. The ontology defines the vocabulary. The knowledge graph defines the relationships. The seven lenses — Home, Projects, Procurement, HR, Resources, Reports, Sales — define the views.

Context Engineering Before It Had a Name

The video describes the emerging field of 'context engineering' — "where one writes, selects, compresses, and isolates knowledge to fill the context window with precisely the information the LLM needs. Nothing more, nothing less."

This is exactly what Groundline's architecture does. When a superintendent asks about Unit 3 hydronic piping, the system doesn't search a haystack. It traverses the knowledge graph:

Work Package → Schedule Activity → Submittal Status → Material Procurement → Crew Assignment → Contract Clause → Inspection Requirements → RFI History

Each node in this traversal is a structured entity with typed relationships. The context window receives precisely the information needed — not because we optimized our chunk retrieval strategy, but because the ontology already knows how these things relate.

The speaker puts it perfectly: "Chunks group related bits of text. Concepts are structured expressions of explicit knowledge." Groundline was built on concepts, not chunks.

Why Construction Needed This First

There's an irony here. The AI research community is just now arriving at a conclusion that construction operators have known intuitively for decades: you can't search your way to understanding a project.

A veteran project manager doesn't answer questions by searching through their filing cabinet. They answer by traversing a mental model — a network of relationships built over years of experience. They know that the Unit 3 delay connects to the procurement issue, which connects to the design change, which connects to the contract amendment. That's not retrieval. That's ontological reasoning.

The tragedy of the Human Synthesis Constraint is that we've been outsourcing this ontological reasoning to human cognition. Every project manager is a walking knowledge graph. When they leave, the graph walks out with them.

Groundline was designed to capture that graph — not as chunks of text in a vector database, but as structured relationships in a domain-specific ontology. This is what the speaker means when he says: "We don't need AI to store more facts. We need it to understand what those facts mean."

The Unified Events Pattern as Knowledge Graph

The speaker argues for grounding LLMs in "structured knowledge" so that outputs are "anchored to verifiable facts, entities and relationships." This is the exact function of our Unified Events Stream.

Every data source — schedule uploads, email forwards, field captures, inspection reports — feeds into a single normalization layer. This layer doesn't just store events; it links them to the entities in our ontology. A daily report entry about a pipe installation becomes a structured event linked to a work package, a crew, a location, a schedule activity, and a quality checkpoint.

When the RAG-based tools of the world try to answer "What happened on Unit 3 last week?" they search for text about Unit 3. When Groundline answers that question, it queries the knowledge graph for all events linked to the Unit 3 entity — across every source, every role, every data type. The answer respects what the speaker calls "the rules of the world model."

From 17,000 Papers to 18 Tables

The video mentions over 17,000 academic papers published on RAG optimization in the last five years. All of them, directly or indirectly, trying to solve an unstructured data problem.

We took a different path. Instead of optimizing how we search through unstructured documents, we structured the domain itself. Eighteen tables. One unified event stream. Seven lenses. A vocabulary and grammar for construction operations that gives every signal a home and every relationship a name.

This isn't a criticism of RAG — it's a recognition that RAG is the wrong abstraction for operational intelligence. RAG is excellent for question-answering over large document corpora. It is insufficient for coordinating work across eleven professional realities operating under capacity collapse.

What This Means for Operators

If you're evaluating AI tools for your construction operations, ask one question: Does this system search your data, or does it understand your operations?

A search-based system will find documents. A structured system will find relationships. The difference is the difference between a file cabinet and a project manager — between retrieval and reasoning.

The video's closing line deserves to be carved in stone: "We don't need AI to store more facts. We need it to understand what those facts mean."

That's what we built. That's what Groundline does. Not because we predicted the context engineering revolution — but because we started from the constraint, not the technology.

The Constraint Series Connection

This article sits at the intersection of several constraints we've explored:

[Knowledge as Constraint](/articles/knowledge-as-constraint): Information is not knowledge. RAG conflates the two by treating retrieval as understanding.

[Ontology as Constraint](/articles/ontology-as-constraint): Without a shared classification system, every role builds a separate mental model. RAG reinforces these silos by returning role-specific fragments without relational context.

[Design as Constraint](/articles/design-as-constraint): Interfaces that mirror database schemas (or search indices) fail operators. Decision surfaces must mirror how humans think about their work — which requires structured relationships, not ranked search results.

[Human Synthesis Constraint](/articles/human-synthesis-constraint): The capstone. Every bottleneck traces back to outsourcing system integration to human cognition. RAG doesn't solve this — it accelerates it by producing more plausible-sounding text that still requires human synthesis to verify and act on.

Context engineering is the research community arriving at the same conclusion our constraint series has been building toward: structure is not optional. It's what makes reasoning possible.

Free Assessment

How Much Institutional Knowledge Is Your Organization Losing?

The average trade contractor loses ~$34,000/year per PM in coordination waste alone. Our Operational Memory Assessment maps where knowledge is leaking, where coordination breaks down, and what it's costing you — in under 10 minutes.

Continue Reading

Projects don't fail from missing data — they fail because nobody agrees on how that data relates. Without a shared ontology, every role builds its own model.

14 min readRead

Every bottleneck — knowledge, coordination, trust, talent, technology — exists because the industry outsourced system integration to human cognition.

13 min readRead

Small businesses drown in information while starving for knowledge. Without a theory of their system, they're improving blindly with metrics and data.

14 min readRead

Stop building navigation hierarchies that mirror database schemas. Start building decision surfaces that mirror how humans actually think about their work.

12 min readRead