Every stalled AI programme we assess traces back to the same absence: nobody agreed who is accountable when the system is wrong. That is a governance question, and it cannot be answered retrospectively.
Why this became urgent
AI moved from experiments into processes that touch customers, employment decisions and regulated advice. At that point the question stops being technical. Regulators, insurers and enterprise procurement now ask how output is reviewed and what the audit trail contains — and an organisation that cannot answer is excluded from contracts on that basis alone.
What governance actually requires
- Review thresholds — which output requires human sign-off, set by consequence rather than by volume.
- Escalation paths — what the system does when uncertain, and who receives it.
- Access control — which data the system can reach, enforced structurally rather than by instruction.
- Audit trail — what the system did, on what input, and why, retained long enough to answer a question months later.
- Revalidation cadence — models and data shift; a system validated once is validated for one moment.
- A named owner — accountable for monitoring, not merely for delivery.
Why the conventional approach fails
Governance is usually written as policy by a team without visibility of the implementation, or skipped entirely by an implementation team treating it as someone else's job. Both produce documents nobody operates. The requirement is that governance decisions are made as build decisions — structural constraints rather than written intentions.
Knowing that review and audit trails matter is easy. Deciding thresholds for your specific risk profile, building constraints the system cannot circumvent, and keeping validation current as models change is engineering and judgement together.
What this means for your business
Governance done properly is a commercial asset, not overhead. It is increasingly what lets you sell into regulated buyers who now ask these questions during procurement. Our analysis of implementation failures covers how often this is the missing piece.