Roadmap / Phase 0—3

Sequence the capability, not the theatre.

The roadmap starts with boundaries that must exist before the first pilot and ends with federation across teams, agents, and regulated workloads. Phase is sequencing; tier is the source deck’s MVP-versus-full distinction. They are not the same thing.

Before any agent runs.

Phase 0 · Foundation

Infrastructure & Runtime

Done when a team can deploy an agent workload to a private-cloud cluster with GPU quota, secrets, a network policy and a tested restore — without filing a ticket.

Single team, contained blast radius.

Phase 1 · Pilot

Model & Inference

Pilot needs one hosted model and one self-hosted fallback behind the same interface, both version-pinned, with a documented switch procedure.

AI Gateway

Pilot needs authentication, per-tenant quota and token metering. Semantic routing and caching are optimisations for phase 2.

Experience & Interaction

Pilot can ship one channel with streaming. Approval and clarification surfaces become mandatory the moment agents can write to production systems.

Retrieval & Context Engineering

Pilot ships hybrid retrieval with reranking and a hard token budget. Add graph retrieval and iterative refinement once you can measure groundedness.

Protocol & Interoperability

Adopt MCP in the pilot to avoid rewriting integrations later. A2A federation and a shared agent registry are the phase 3 workstream, once more than one team runs agents that must delegate to each other.

Orchestration & Durable Execution

Pilot needs a single orchestrator with durable checkpoints and a hard step and budget ceiling. Multi-agent topologies only after a single agent has been measured and found insufficient.

Security, Safety & Guardrails

Pilot needs injection screening, PII redaction, output validation and workload identity. Full supply-chain control and inter-agent security are mandatory before production data or write access.

Observability & FinOps

Instrument from the first pilot request. Retrofitting correlation IDs after the fact is the most common and most expensive omission in this whole composition.

Evaluation & Assurance

Pilot needs a golden set and a regression suite fed by real incidents. Adversarial campaigns arrive with production; simulated users and environments are the phase 3 workstream for rehearsing at scale.

Real systems, real data, real users.

Phase 2 · Production

Domain & Semantic

Start with the twenty terms that appear in disputed answers, not a full enterprise ontology. Expand only where ambiguity has actually cost something.

Data Integration & Provenance

Connect three sources properly — contract, lineage, entitlements — before connecting thirty carelessly. MCP data servers shorten integration work substantially, but the governance is the slow part, not the plumbing.

Memory & State

Pilot may use session-scoped memory only. Long-lived cross-session memory should not ship before poisoning controls and erasure both work.

Tool, Skill & Sandbox

Ship read-only tools in the pilot. Every write tool should arrive with an approval path, an idempotency key and a rollback story — no exceptions in phase 2.

Governance, Oversight & AgentOps

Keep it lightweight in the pilot: an agent registry, an owner per agent and a written autonomy tier. Promote to full control the moment agents touch production systems or personal data — before any traffic, not after.

Many agents, many teams, regulated load.

Phase 3 · Scale & federation

ML & Decision Intelligence

A scale-phase optimisation: introduce when volume makes a measured LLM path too slow, too costly or too imprecise for a repeated decision. Do not create a parallel ML organisation — reuse the same registry, evaluation and observability harnesses.

A USEFUL DEFINITION OF DONE

Each phase is complete when its controls can produce evidence under failure—not when the happy-path demo runs once.