AI Governance  ·  Enterprise Accountability

Who Answers When Your AI Gets It Wrong

Every tier in the AI deployment chain has a contractual mechanism to pass accountability to the next one. Foundation labs point to acceptable use policies. Enterprise deployers point to employee training. Employees point to the guidance they were given. This post maps where accountability actually lives, coins two constructs for why it disappears, and gives General Counsel and the CISO a framework for assigning it before the regulator assigns it for them.

Arjun Jaggi  ·  September 17, 2026  ·  12 min read
€35M Maximum EU AI Act penalty for prohibited AI practices. Regulation 2024/1689, Art. 73(1) [1]
3 Primary accountability tiers formally defined in EU AI Act Art. 3. Provider, deployer, and user each carry distinct obligations [1]
2026 Year EU AI Act deployer obligations for high-risk AI systems became enforceable. Organizations without formal accountability structures face live regulatory exposure [1]

Enterprise AI has reached scale without resolving a foundational question. When an AI system causes harm in an enterprise setting (a misclassified loan application, a hallucinated legal clause, a biased hiring recommendation) the organization needs to know, in advance, who answers for it. The answer today is genuinely unclear. Every tier in the deployment chain has a mechanism to point to the next tier. Foundation model labs transfer accountability through acceptable use policies. Enterprise deployers transfer it through employee guidelines. Internal operators transfer it through tool approval processes. By the time a material failure occurs, the organization is often left holding the consequence of a design decision made two or three tiers upstream, with no documented chain of who owned what.

This is not a legal edge case. It is the operating condition for most enterprise AI deployments in 2026. The EU AI Act has begun to impose formal obligations on deployers and providers [1], and the proposed AI Liability Directive would extend civil liability rules to AI-caused harm [3]. But regulation names categories without solving the internal assignment problem: within your organization, which role owns the design decision that made a given harm possible? That question has no external answer. It has to be built.

Definition. Accountability Arbitrage

The active or passive structuring of AI deployment relationships such that legal and moral responsibility is distributed across enough actors (foundation model labs, enterprise deployers, internal operators, and end users) that no single party bears sufficient consequence to change behavior. Distinct from ordinary liability limitation in that the distribution is architectural, not merely contractual. The accumulation of ToS agreements, acceptable use policies, and employee guidelines across the chain creates a system where every actor has a plausible basis for pointing elsewhere, and no actor is positioned to own the full consequence of a system-level design decision. The term originates with this work.

Definition. Responsibility Gravity

The structural tendency in AI deployments for accountability to flow toward the party with the least power to resist it, regardless of where the design decision that made harm possible actually originated. Responsibility Gravity means that employees, who have no authority over model capabilities, no input into acceptable use policies, and no contract with the foundation model provider, become the de facto accountability sink for harms that originate in decisions made two or three tiers above them. The gap between where accountability lands and where design authority sat is the core organizational failure this term names. The term originates with this work.

How the Chain Passes Accountability Down

The AI deployment chain has a consistent structure across enterprises. A foundation model lab trains a model with a set of capabilities and publishes an acceptable use policy that defines what deployers may and may not build. An enterprise deploys that model, either directly through an API or through a vendor product, and configures it for internal use cases. Internal operators (IT, AI platform teams, line-of-business owners) deploy specific tools to specific employee groups, often with a usage guideline or acceptable use addendum. Employees use the tools and are told to verify outputs before acting on them.

Each transfer in this chain is documented. Each documentation step creates a surface for the upstream party to point downstream when harm occurs. The result is not deliberate bad faith at any single tier. It is a structural property of how accountability flows through layered systems when no one explicitly designs the assignment.

Fig. 1. The Accountability Transfer Chain
Foundation Lab Enterprise Deployer Internal Operator Employee ToS and policy transfers cascade accountability downward Accountability Gap Zone Governance Body Enforcement lags deployment Harm Event Who owns the response? Enforcement response

The Accountability Gap Zone in the diagram represents the space where harm occurs but formal accountability has not been assigned in advance. The governance body represents both internal governance functions (AI ethics boards, legal, compliance) and external regulators. Both are connected to harm events by a slow, dotted path. Enforcement typically arrives after the damage.

Three Failure Modes That Let Harm Escape the Chain

Failure Mode 1. The Transfer Chain

Every tier in the deployment stack documents a transfer of accountability to the tier below. Foundation labs publish acceptable use policies. Enterprise deployers require employees to complete AI literacy training and sign off on usage guidelines. Internal operators add tool-specific restrictions. The cumulative effect is a documented chain that every upstream actor can cite when harm occurs. No single tier is positioned to own the full system-level design decision.

Early warning signal. Your AI acceptable use policy is longer than your AI training program. When the documentation of restriction outpaces the documentation of accountability, the transfer chain is active.

Mitigation. Establish upstream accountability agreements with foundation model providers that explicitly define which capabilities constitute provider obligations vs. deployer obligations. Define, in writing, which use cases your enterprise has enabled and which design decisions that represents. The EU AI Act Article 25 deployer obligations are a useful starting framework [1].

Failure Mode 2. The Governance Lag

Regulation arrives after deployment patterns are normalized. Organizations that deployed AI tools in the 24-36 months before enforcement began operated without consequence for patterns that are now subject to obligation. The absence of enforcement during the early deployment window creates a false sense that the status quo is compliant. When enforcement begins, the status quo is often not.

Early warning signal. Your legal counsel describes the regulatory environment as "still developing" and your AI deployment is already live. Governance lag creates a window where harm can occur without regulatory consequence, but the harm creates precedent that is difficult to undo when enforcement does arrive.

Mitigation. Adopt EU AI Act deployer obligations proactively, even where not yet jurisdictionally required. They represent the emerging global floor. The OECD AI Principles [4] provide a framework that is geographically broader than EU law and captures the accountability intent that most regulatory developments are converging toward.

Failure Mode 3. Accountability Sedimentation

When a formal AI incident occurs, accountability tends to settle on the most recent human in the chain, the employee who approved the AI output or the operator who deployed the tool, regardless of whether the design decision that made harm possible originated three tiers upstream. This is Responsibility Gravity in practice. The employee had no authority over model capabilities, no input into acceptable use policy design, and no contract with the foundation model provider. They nonetheless hold the highest practical accountability exposure in most enterprise accountability structures.

Early warning signal. Your AI policies include language assigning employees responsibility for verifying all AI outputs, without defining the standard of verification or the limits of that responsibility. Unlimited verification responsibility is a Responsibility Gravity structure.

Mitigation. Build a formal AI Incident Ownership model that traces each category of harm back to the tier responsible for the design decision that created the capability. A hallucination from a foundation model that was not disclosed as a known limitation is a provider-tier obligation. A use case the enterprise chose to enable against provider guidance is a deployer-tier obligation. Defining these in advance is the only way to close Accountability Sedimentation before it activates.

Accountability Profile by Deployment Tier

Accountability Profile by Deployment Tier
Foundation Lab
Foundation labs control which capabilities exist and how they behave by default. Their acceptable use policies define what deployers may and may not build. When harm originates from a capability the model was trained to have, this tier is where design accountability lives. Current law holds labs to strict standards for prohibited practices under the EU AI Act, but enforcement reach across global enterprise deployments remains operationally limited at present.
Capability Design Authority AUP Publisher Limited Enforcement Reach

This widget illustrates the accountability profile across deployment tiers. The bars show directional relative values for four dimensions, not empirical measurements. Design the accountability structure for your own organization based on your specific deployment model.

The Decision Framework for Incident Ownership

When an AI incident occurs, the first question the General Counsel and the CISO face is which tier owns the response. The following framework provides a first-pass assignment. It is not a substitute for legal counsel but is designed to allow a fast initial triage within the first 24 hours of an incident.

Harm Origin Primary Tier Escalation Path Documentation Needed
Capability the model was not disclosed to have Foundation Lab Legal against provider; AUP review Model documentation, AUP at time of deployment
Use case the enterprise chose to enable against provider guidance Enterprise Deployer Internal AI governance; Board reporting if high-risk Deployment decision record, risk assessment at launch
Configuration made by an internal team without risk review Internal Operator IT governance; AI platform team review Configuration change log, approval chain
Specific output an employee approved without adequate verification Employee (with upstream review) HR protocol; review whether verification standard was defined Usage log, training completion record, verification standard definition
Harm to a third party from an enterprise AI product Enterprise as Provider (EU AI Act Art. 25) Legal; Regulatory notification if high-risk AI System conformity assessment, fundamental rights impact assessment
Design Authority vs. Accountability Exposure by Tier
Directional illustration of the inversion between design authority (who controlled the capability decision) and accountability exposure (who faces practical consequence when harm occurs). The gap between these two for the Employee tier is the Responsibility Gravity effect. Values are directional illustrations, not derived from systematic survey data.

Three Enterprise Scenarios

Scenario 1. Chief Risk Officer, Regional Bank

A mid-size regional bank deploys a generative AI model for loan underwriting support. The model produces explanations for credit decisions that are factually plausible but statistically inconsistent with the underlying score. Loan officers are told to "use AI suggestions as one input." When a regulatory examination identifies disparate impact in AI-assisted decisions, the bank's accountability structure assigns the failure to "officer judgment" rather than to the model's explanation mechanism. The CRO lacks documentation showing whether the use case was reviewed as a high-risk AI system under the bank's own risk framework before deployment. Under EU AI Act Article 6, credit scoring and creditworthiness assessment are high-risk AI applications. Formal conformity assessment is required for providers and deployers [1]. The correct accountability tier is the Enterprise Deployer. The corrective action is a retroactive conformity assessment, documented configuration review, and a revised incident ownership framework that traces explanation failures to the system design tier, not the officer tier.

Scenario 2. General Counsel, Healthcare Network

A large healthcare network deploys a vendor AI product for clinical documentation. A physician uses an AI-generated note that omits a contraindication. The network's AI acceptable use policy states that "all AI-generated clinical content is the responsibility of the clinician." When the incident is reviewed, the General Counsel discovers that the AI governance board never reviewed the vendor product for clinical risk before deployment, the vendor's acceptable use policy limited liability to "incorrect user inputs," and the physician's AI training covered general AI literacy but not the specific failure modes of this documentation tool. All three tiers deflect. The patient harm has no clear internal owner. The NIST AI RMF Govern function [2] specifically addresses this scenario. The organization-level risk governance required before deployment defines who owns the design decision. Without that governance record, the accountability structure at incident time is reconstructed from absence rather than from documentation.

Scenario 3. Chief Information Security Officer, Insurance Company

An insurance company's claims processing team adopts an AI tool that flags potentially fraudulent claims. The tool is deployed by an internal team without a formal risk review. A pattern emerges where claims from a specific geographic region are disproportionately flagged. The CISO is asked to investigate after a regulatory inquiry. The investigation reveals that the foundation model was fine-tuned on historical claims data that reflected prior discriminatory patterns, the internal team that deployed the tool had no process for documenting the training data provenance, and the employees using the tool were told to "apply professional judgment" to AI flags. Responsibility Gravity has concentrated the accountability on the claims team, whose professional judgment was invoked, rather than on the model training decision or the deployment decision. The correct accountability assignment begins at the Internal Operator tier for failing to document data provenance, and at the Enterprise Deployer tier for failing to classify the use case as high-risk before deployment.

Governance Coverage vs. Deployment Maturity by AI Category
Directional illustration of the governance lag across three categories of enterprise AI. Agentic AI has the highest deployment growth rate and the lowest regulatory coverage at present. Values are directional illustrations of market-wide trends, not derived from systematic survey data.

What It Costs to Leave the Gap Open

Regulatory Exposure

EU AI Act deployer violations carry penalties up to 15 million EUR or 3% of global annual turnover. Providers face up to 35 million EUR or 7% for prohibited practice violations. Organizations without formal tier assignments cannot demonstrate compliance [1].

Civil Liability Risk

The proposed AI Liability Directive would require defendants to disclose evidence about AI systems used in a disputed decision. Without documented accountability assignments, disclosure requests may require comprehensive system review rather than targeted documentation retrieval [3].

Talent and Governance Cost

When accountability is concentrated at the employee tier through Responsibility Gravity, AI adoption slows because practitioners rationally avoid tools where error carries personal professional consequence without corresponding authority. This is a measurable adoption drag, though it has not been empirically quantified in published literature at enterprise scale. Structural design change reduces it.

Incident Response Time

Enterprises without pre-defined incident ownership frameworks experience materially longer response times because the first phase of every incident is spent assigning accountability rather than addressing harm. Documented tier ownership converts an internal negotiation into a protocol execution.

Cross-Reference

The EU AI Act compliance obligations for deployers of high-risk AI systems are mapped in detail in the EU AI Act compliance deep-dive on arjunjaggi.com, including the specific Article 25 requirements that form the legal floor for enterprise deployer accountability. The accountability gap framework in this post is designed to operate on top of that compliance floor, not to replace it.

Cross-Reference

Agentic AI compounds the accountability gap significantly. When an AI agent takes a sequence of actions autonomously, the "employee verification" mechanism that most enterprise policies rely on does not apply. There is no human checkpoint between model decision and system action. The agentic governance challenge is documented in Agentic Governance Debt, and the accountability framework in this post should be extended to cover autonomous agent action chains as a distinct harm origin category.

The Executive Accountability Checklist

This checklist is designed for the General Counsel, CISO, or Chief AI Officer conducting an accountability readiness assessment. The questions reflect the minimum structural requirements for demonstrating formal accountability assignment before an incident occurs.

Cross-Reference

The Chief AI Officer's role in owning the accountability architecture described in this checklist is detailed in The Seat Nobody Sets Up. The five infrastructure layers the CAIO requires to operate at the strategic level, including the governance infrastructure that makes formal accountability assignment possible, are mapped there. An enterprise that has deployed AI at scale without a CAIO with formal authority is likely operating with Accountability Arbitrage as a structural condition, not an isolated gap.

Build, Buy, Configure

What to Build

The AI Incident Ownership model. This is the core internal artifact that no vendor product provides. It maps each harm origin category to a tier, names the executive who owns the response for that category, defines the documentation that tier must maintain, and specifies the escalation path. Building it requires Legal, the CISO, the CAIO (or equivalent), and a sample of the business owners who operate AI tools. Budget 30-60 days for a first version with tabletop validation.

What to Buy

AI governance platforms that provide use case registries, risk assessment workflows, and audit trails. These tools automate the documentation layer that supports accountability assignment but do not replace the ownership model. Procurement evaluation should focus on whether the platform generates the specific documentation that EU AI Act Article 9 conformity assessments require. Category vendors exist in the AI risk management space; evaluate on documentation structure, not on feature breadth.

What to Configure

Existing ITSM and GRC platforms to extend AI-specific harm categories into incident response workflows. Most organizations already have incident management infrastructure. The gap is that AI harm categories are not mapped into the classification taxonomy. Configuration investment is moderate, and the return (faster incident triage, documented accountability chain) is immediate. This is the quickest close for the most common gap.

The Three-Phase Accountability Roadmap

Phase 1  ·  Weeks 1-6

Audit and Map

Inventory all deployed AI systems. Classify each as provider or deployer under EU AI Act definitions. Identify high-risk use cases. Review upstream provider AUPs for each system. Deliver a written accountability gap assessment to Legal and the board. Go/no-go gate. Does Legal confirm the classification of each system? Is the gap assessment approved for executive review?

Phase 2  ·  Weeks 7-14

Build the Ownership Model

Develop the AI Incident Ownership model with Legal, HR, and the CISO. Define verification standards for employees for each use case category. Extend existing incident response workflows to AI harm categories. Run a tabletop simulation. Deliver a revised acceptable use policy that defines verification standards, not just responsibility. Go/no-go gate. Does the tabletop reveal gaps in the ownership model? Is the revised AUP approved by Legal?

Phase 3  ·  Weeks 15+

Operate and Audit

Integrate accountability review into the procurement process for new AI tools. Establish a quarterly accountability audit cadence. Maintain a live use case registry with tier classification. Assign board-level reporting for AI governance. Success criteria. All deployed AI systems have documented tier assignments. At least one tabletop has been run per year. Legal has confirmed EU AI Act deployer obligation compliance for all high-risk systems.

Excited about AI, innovation, and growth?

Start a conversation

References