AI Governance for Teams That Ship in 2026: An Operating Model, Not a Policy PDF
Published August 17, 2026·12 min read
TL;DR
Operational AI governance is the set of controls that gate what you deploy, not a policy document. Build it on NIST AI RMF's four functions — Govern, Map, Measure, Manage (NIST.AI.100-1, released Jan 26, 2023) — then wire in a named operating model, an AI system registry, risk tiers, pre-deployment gates, and an incident runbook. This playbook ships all of it plus a single crosswalk mapping each control to NIST AI RMF, ISO/IEC 42001:2023, and dated EU AI Act obligations (Article 50 transparency lands Aug 2, 2026).
What is AI governance for teams that ship — and how do you govern the AI you deploy in 2026?
AI governance for teams that ship is the set of controls that gate what you deploy — an operating model, a system registry, risk tiers, pre-deployment review gates, evals, monitoring, and an incident runbook — not a policy essay. The fastest way to make it real is to build on the NIST AI Risk Management Framework, which is organized into four core functions: Govern, Map, Measure, and Manage (NIST.AI.100-1, released January 26, 2023 as voluntary guidance). Govern is cross-cutting; Map sets risk context; Measure assesses risk; Manage covers risk treatment and incident response (NIST). Everything below maps every internal control back to one of those four functions, then crosswalks it to ISO/IEC 42001:2023 and the EU AI Act.
The data: what the frameworks and the market actually say
- NIST AI RMF 1.0 has 4 functions — Govern / Map / Measure / Manage — released Jan 26, 2023 (NIST.AI.100-1) (NIST).
- The NIST Generative AI Profile (NIST-AI-600-1) was released July 26, 2024, extending the RMF to GenAI-specific risks such as confabulation, prompt injection, and data privacy — same four functions (NIST).
- ISO/IEC 42001:2023, published December 2023, is the first certifiable international standard for an AI Management System (AIMS): build against clauses 4–10, select applicable Annex A controls, then certify via Stage 1 (documentation) and Stage 2 (operational) audits (ISO).
- The EU AI Act entered into force August 1, 2024; prohibited-practice bans and AI-literacy duties began February 2, 2025; GPAI obligations, governance provisions, and penalties began August 2, 2025; general application lands August 2, 2026 (artificialintelligenceact.eu; Gibson Dunn).
- The OWASP Top 10 for LLM Applications 2025 puts LLM01 Prompt Injection in the top spot, with System Prompt Leakage and Vector & Embedding Weaknesses new to the 2025 edition (OWASP GenAI Security Project).
- Per secondary reporting of a Deloitte enterprise AI-agent survey, roughly 74% of enterprises expect moderate-to-extensive AI agent adoption within two years, yet only about 21% describe their AI governance as mature — a deploy-vs-govern gap. Treat these figures as directional pending Deloitte's primary report (via PartnerInAI).
The operating model: name who owns what
Most "AI governance framework" pages describe committees; teams that ship need named owners tied to specific artifacts. Assign five roles and make ownership unambiguous. This operationalizes NIST Govern, which is the cross-cutting function (NIST).
| Artifact / decision | System Owner | Governance / Risk Lead | Security | Legal / Compliance | ML / Engineering |
|---|---|---|---|---|---|
| AI system registry entry | Accountable | Consulted | Informed | Informed | Responsible |
| Risk-tier assignment | Responsible | Accountable | Consulted | Consulted | Informed |
| Pre-deployment review gate | Responsible | Accountable | Consulted | Consulted | Responsible |
| Evals + monitoring thresholds | Consulted | Consulted | Consulted | Informed | Accountable |
| Incident response | Responsible | Consulted | Accountable | Consulted | Responsible |
| Regulatory mapping (EU AI Act / state law) | Informed | Consulted | Informed | Accountable | Informed |
The System Owner is the single throat to choke for a given AI system — they own its registry entry and its business purpose. The Governance/Risk Lead owns the tiering decision and the gate. This is the "who owns what" layer competitors gesture at but rarely name.
The AI system registry: the one artifact everyone mentions and no one specs
A registry (or inventory) is how you operationalize Govern — you cannot govern systems you cannot enumerate. Every AI system in production gets one row with these fields:
| Field | Example value | Why it matters |
|---|---|---|
| System ID | svc-support-triage-01 |
Stable key for audit trails |
| Owner | Name + team | Accountability (RACI above) |
| Purpose | "Classify inbound support tickets" | Maps to intended use under EU AI Act |
| Data classes | Customer PII, ticket text | Drives risk tier + EU AI Act duties |
| Model + prompt version | gpt-class-v4 / prompt@a91f |
Reproducibility, drift, rollback |
| Tools / credentials | Zendesk write, CRM read | Excessive Agency exposure (OWASP LLM06) |
| Risk tier | Tier 2 | Determines gate depth |
| Status | Production / staging / retired | Lifecycle state |
| Last review date | 2026-08-18 | Forces periodic re-review |
Version the registry in the same repo as your code so an entry is a merge requirement, not an afterthought. This is the artifact that turns NIST Map (set risk context) into something enforceable.
Risk tiering: objective triggers, not vibes
The EU AI Act uses risk tiers — prohibited, high-risk, limited-transparency, and minimal — as its regulatory backbone (artificialintelligenceact.eu). Mirror that internally with objective triggers so tiering is repeatable.
| Tier | Objective triggers | Review depth |
|---|---|---|
| Tier 1 — Low | Internal-only, no PII, human reviews every output, no external actions | Registry entry + owner sign-off |
| Tier 2 — Elevated | Customer-facing, or touches PII, or takes bounded external actions | Registry + eval suite + security review + monitoring |
| Tier 3 — High | Consequential decisions (credit, hiring, health, safety), or autonomous actions on production systems | Full gate: evals, red-team, legal review, human-in-the-loop, incident runbook, executive sign-off |
Map each internal tier to its likely EU AI Act category and confirm with Legal — a Tier 3 system may fall under high-risk obligations or Article 50 transparency duties depending on use.
Pre-deployment review gates: governance you can enforce in CI/CD
Tie gates to the lifecycle so each stage transition requires passing controls. This makes evals and monitoring governance controls, not just MLOps hygiene.
- Registration gate (Map). No system reaches staging without a complete registry entry and an assigned risk tier. Enforce as a merge check.
- Staging / eval gate (Measure). The system must pass a versioned eval suite against your defined thresholds. For LLM systems, fold in the NIST Generative AI Profile risk categories (confabulation, prompt injection, data privacy) and run adversarial tests against the OWASP LLM Top 10 — starting with LLM01 Prompt Injection (NIST; OWASP).
- Production gate (Manage). Tier 2+ requires security review, defined rollback, and a signed-off monitoring plan before traffic. Tier 3 adds legal review and human-in-the-loop.
- Monitoring gate (Measure + Manage, continuous). Drift, output-quality regression, cost/latency anomalies, and safety-eval failures page the owner and can auto-rollback. A failed threshold is a governance event, not just an alert.
Dexity Intel · free newsletter
Liking this? Get the next one in your inbox.
JD-backed career reads, AI market signals, and field-tested tool guides — a few times a month. No fluff, no spam.
Incident response: a runbook mapped to NIST Manage and the OWASP LLM Top 10
Manage covers risk treatment and incident response (NIST). Pre-write the runbook so on-call is not improvising.
- Detect. Monitoring threshold breach, user report, or red-team finding. Classify against the OWASP LLM Top 10 2025 failure mode — e.g., Prompt Injection (LLM01), Sensitive Information Disclosure (LLM02), System Prompt Leakage, Data & Model Poisoning, or Excessive Agency (OWASP).
- Contain. Roll back to the last known-good model + prompt version from the registry; revoke over-broad tool credentials.
- Assess. Owner + Security determine blast radius; Legal checks for notification/transparency obligations (EU AI Act Article 50 transparency duties apply from Aug 2, 2026).
- Remediate + learn. Patch, add an eval that would have caught it, update the registry review date, and record the incident as evidence for your ISO/IEC 42001 management review.
The differentiator: one controls-to-frameworks crosswalk
This is the table incumbents gesture at but never build cleanly — each internal control mapped to its NIST AI RMF function, the relevant ISO/IEC 42001 layer, and the specific EU AI Act obligation with an honest date.
| Internal control | NIST AI RMF function | ISO/IEC 42001:2023 | EU AI Act obligation + date |
|---|---|---|---|
| Operating model + accountability | Govern | Clauses 5 (leadership), 6 (planning) | Governance provisions applying Aug 2, 2025 (timeline) |
| AI system registry / inventory | Govern → Map | Clause 8 (operation) + Annex A controls | Underpins provider/deployer duties across the phased timeline |
| Risk tiering | Map | Clause 6.1 (risk), Annex A | Mirrors Act risk tiers (prohibited / high-risk / limited / minimal) |
| Prohibited-use screen | Map | Clause 8 | Prohibited-practice bans applied Feb 2, 2025 |
| Evals / testing | Measure | Clause 9 (performance evaluation) | Evidence toward high-risk conformity duties |
| Monitoring / drift | Measure → Manage | Clause 9.1 (monitoring) | Ongoing post-market monitoring expectation |
| Transparency to users | Manage | Annex A | Article 50 transparency for chatbots + synthetic content, live Aug 2, 2026 (Gibson Dunn) |
| Incident response | Manage | Clause 10 (improvement) | Serious-incident handling under high-risk regime |
| GPAI / model-provider duties | Govern → Manage | Clauses 4–10 | GPAI obligations from Aug 2, 2025; legacy GPAI grace to Aug 2, 2027 |
Honest caveat on high-risk timing. Under the EU Digital Omnibus (Commission proposal published Nov 19, 2025; political/provisional agreement reached May 2026), high-risk obligations are proposed to be postponed — stand-alone Annex III systems to December 2, 2027, and AI embedded in regulated products under Annex I to August 2, 2028. These changes take legal effect only upon formal adoption and publication in the Official Journal (expected before Aug 2, 2026) — treat as not-yet-final (Gibson Dunn). Article 50 transparency stays on Aug 2, 2026 regardless of high-risk postponements.
US deployers, don't wait for Brussels. State law is the domestic analogue and it is in flux: Colorado's original AI Act (SB24-205) was delayed to June 30, 2026 (via SB25B-004), then replaced by SB26-189, signed May 14, 2026, taking effect January 1, 2027; Texas TRAIGA is the other deployer-facing regime to track (Seyfarth). Build to NIST AI RMF and you are largely portable across both.
The 30-day minimum viable governance rollout
- Week 1 — Inventory. Stand up the registry and log every AI system in production. Assign owners (Govern).
- Week 2 — Tier + gate. Apply the 3-tier model; wire the registration and eval gates into CI/CD (Map + Measure).
- Week 3 — Evals + monitoring. Ship a versioned eval suite for Tier 2+ systems and turn on drift/quality monitoring with paging thresholds (Measure + Manage).
- Week 4 — Incident + crosswalk. Publish the incident runbook and complete the framework crosswalk with Legal, dating each EU AI Act / state-law obligation (Manage + Govern).
Frequently asked questions
What is the difference between AI governance and an AI policy?
An AI policy is a written statement of intent; AI governance is the set of controls that enforce it — registry, risk tiers, pre-deployment gates, evals, monitoring, and incident response. For teams that ship, the test is simple: can the control block a deploy? If not, it is policy, not governance.
Which framework should we start with — NIST AI RMF, ISO 42001, or the EU AI Act?
Start with NIST AI RMF as your operating-model backbone — its four functions (Govern, Map, Measure, Manage) map cleanly onto controls and it is voluntary and free (NIST). Use ISO/IEC 42001:2023 when you need a certifiable management system, and treat the EU AI Act as the dated obligation layer you map controls to.
When do EU AI Act obligations actually apply?
Phased: prohibited practices and AI-literacy duties from Feb 2, 2025; GPAI and governance provisions from Aug 2, 2025; general application and Article 50 transparency from Aug 2, 2026. Proposed high-risk postponements (Annex III to Dec 2, 2027, Annex I to Aug 2, 2028) are not yet final pending formal adoption (artificialintelligenceact.eu; Gibson Dunn).
How do evals and monitoring count as governance controls?
They are your Measure function under NIST AI RMF. A versioned eval suite that gates deploys and monitoring thresholds that page owners and can auto-rollback turn model quality into an enforceable control — and they double as evidence for an ISO/IEC 42001 Stage 2 operational audit (ISO).
What threats should a pre-deployment review gate test for?
For LLM and agent systems, test against the OWASP Top 10 for LLM Applications 2025, starting with LLM01 Prompt Injection, plus Sensitive Information Disclosure, Excessive Agency, System Prompt Leakage, and Data & Model Poisoning (OWASP). Fold in the NIST Generative AI Profile's GenAI risk categories for confabulation and data privacy.
Do US teams need to care about the EU AI Act?
If you serve EU users you do. Even if you don't, US state law is converging on similar deployer duties — Colorado's SB26-189 (effective Jan 1, 2027) and Texas TRAIGA (Seyfarth). Building to NIST AI RMF keeps you portable across both regimes.
Related reading
- AI governance in 2026
- Streamlining AI evaluation in production with data collection and error analysis
- AI red teaming in 2026
Governance is a skill you build by shipping controls, not by writing policy. If your team already has AI in production and needs an operating model, registry, gates, and an incident runbook you can enforce, work through it hands-on in the Govern the AI You Ship sprint.
Sources: NIST — AI Risk Management Framework; ISO/IEC 42001:2023; EU AI Act Implementation Timeline (artificialintelligenceact.eu); Gibson Dunn — EU AI Act Omnibus Agreement; OWASP GenAI Security Project — Top 10 for LLM Applications 2025; Seyfarth — Colorado enacts AI replacement law (SB26-189); Deloitte enterprise AI-agent survey (via PartnerInAI, directional).
Go from reading to doing · Dexity Sprint
Govern the AI You Ship
Most engineering managers and GRC leads inherit AI systems in production with no governance program behind them. This sprint gives you the frameworks, decision tools, and documentation to build one — from policy design to incident response — in four weeks.
