AI Harness Reference Architecture

Fact-check status

Reviewed claim by claim on 2026-09-02 against the primary or official sources identified inline as S1 and S2. Recommendations are design guidance unless a cited standard makes them normative.

Key jargon

Term	Plain-language meaning
Control plane	Components that decide policy, routing, permissions, and workflow state. S1
Data plane	Components that carry prompts, retrieved context, tool data, and model outputs. S1
Adapter	A boundary translating a stable internal contract to a provider-specific interface. S1
Policy engine	Code that evaluates whether an operation is allowed. S1

Key concepts

Separate control decisions from model-generated content so text cannot grant itself authority. S1
Stable internal contracts isolate the application from changing providers and frameworks. S1

Concept map

flowchart LR
    A["Request enters control plane"] --> B["Assemble governed context"]
    B --> C["Invoke model and tools"]
    C --> D["Record evaluate return"]

Diagram semantics verified against S1 and S2 on 2026-09-02.

Layer	Responsibility	Evidence
Interface	User intent, authentication, confirmation, accessibility	Request and user/session ID S1
Policy	Scope, data rules, tool rules, budgets, stop gates	Policy version and decision S1
Orchestration	Workflow/graph, transitions, queues, retries	Run and step state S1
Context	Instructions, history, retrieval, source trust	Context manifest and hashes S1
Model	Provider adapter, version, parameters, routing	Model ID and usage S1
Tool gateway	Schema, authorization, execution, result normalization	Call, identity, response, effect ID S1
Memory/state	Durable facts, preferences, artifacts, checkpoints	Provenance and retention metadata S1
Validation	Schema, business rules, citations, tests, safety checks	Assertions and disposition S1
Operations	Tracing, metrics, cost, incidents, evals	Trace and scorecard S1

Design rule

Each layer should be replaceable and testable. If changing the model requires rewriting permissions, storage, and business logic, boundaries are too coupled. S1

Exercise

Map an existing RAG chatbot into the table. If a layer is absent, write “absent” rather than assigning it to the model.