ZiffyVolve
Back to Part II
The Economics of AI at ScalePart III · The Risk Problem

ZiffyVolve Executive Insight

What the Meter
Cannot See

A system can look good on average while exceptions carry materially different business consequences. The management question is whether the evidence fits the scope and consequence of delegated authority.
By Vinay Prathy8 minute read
Illustrative business-performance comparison

The same average can conceal a different decision.

98%acceptable business outcomes
2%Correct before releaseDrafting errors remain reviewable.
2%Act, then remediateA financial or account action may be difficult to reverse.

Average performance is the same. Consequence is not.

A good average is not the whole business case

A system can look good on average while its exceptions carry consequences that change the business case. That distinction becomes more important as AI moves from producing work to making—or influencing—decisions.

Part II ended with a distinction that matters: scaling the volume of an existing task is not the same as delegating new authority. An AI system that drafts 10,000 customer responses is doing more of the same work. An AI system that begins approving refunds, changing commercial terms or committing spend has crossed a different boundary.

The question is no longer only whether the system performs well enough on average. It is: what happens when the exceptions are economically different from the routine?

That is where averages begin to fail.

The Same Average Can Hide Different Risks

Executives are accustomed to managing averages: average cost per transaction, average cycle time, average conversion and average error rate. Those measures are useful because many operating problems behave reasonably well around the middle.

AI creates a complication when the consequence of an error is not evenly distributed.

Consider two illustrative workflows. Both deliver a 98% acceptable business-outcome rate. The figure is a simplified performance comparison, not a universal AI accuracy benchmark. In the first, the remaining 2% create minor drafting errors that a reviewer corrects before anything reaches the customer. In the second, the remaining 2% include an incorrect credit, an unauthorized commitment or an action on the wrong account.

The average performance may be identical. The economics are not. What matters is not simply how often the system fails. It is what happens when it does.

Exhibit 1 · The 98% problem

Same rate.
Different consequence.

Two workflows report the same result. Only one keeps the exception inside the review boundary.

98%acceptable business outcomes2% exception
Routine draftingReviewer catches the exception
Review boundary
ContainedCorrect before release
98%acceptable business outcomes2% exception
Executed actionThe exception becomes the outcome
Execution boundary
ExposedRemediate after action
What the average omitsFrequency is unchanged.
Exposure is not.

Illustrative business-performance comparison. The 98% figure is not a universal AI accuracy benchmark, measured client result or quantified risk estimate.

That distinction is already familiar to finance. A portfolio with many small losses is not economically equivalent to one with the same average loss but a small probability of severe exposure. A manufacturing process with frequent cosmetic defects is different from one with rare safety failures. AI should be managed with the same discipline.

Frequency and severity together determine the exposure.

More throughput is not more authority

A pilot often begins inside a narrow boundary. Draft the response. Summarize the file. Recommend the next action. A person still makes the consequential decision.

Success creates pressure to expand. If the drafting works, why not send the response automatically? If the recommendation is usually right, why not approve the refund? If an invoice exception is resolved correctly most of the time, why not let the workflow post the adjustment?

Each step may look incremental, but it changes the consequence profile because the system is moving from producing information to exercising authority.

A drafting error can often be intercepted before it becomes a business outcome. An executed financial action may be difficult to reverse.

Evidence that supports more throughput within one scope does not automatically establish performance under a different scope of authority. When authority changes, the evidence should be appropriate to the permissions granted and the consequences that become possible.

Expanding a customer-service workflow

Assume an AI-supported workflow has demonstrated that it can classify routine customer requests, retrieve the right account information and draft responses that employees accept with limited correction. Management now wants to automate more of the workflow.

Management accepts less automation of financial and contractual actions in exchange for tighter control over exposure.

The workflow may send verified order-status updates automatically to the verified customer contact.

Refunds, account changes and changes to commercial terms remain subject to human approval.

Cases with missing or contradictory information escalate to an accountable employee.

Exhibit 2 · Executive decision framework

Evidence should match the scope and consequence of delegated authority.

The same performance evidence supports different operating postures depending on the authority and exposure embedded in the action.

Consequence of action →
High consequence · weak evidence

Retain human authority

Do not delegate financial, policy-changing or irreversible decisions.

Stop
High consequence · strong evidence

Bounded autonomy

Permit defined actions with explicit limits, approvals and escalation.

Control
Low consequence · weak evidence

Pilot under review

Build evidence in a reversible workflow while humans catch exceptions.

Learn
Low consequence · strong evidence

Scale within mandate

Increase routine throughput without silently expanding decision rights.

Scale
Evidence appropriate to the changed authority and consequence
Limited evidenceEvidence strength →Decision-grade evidence

Before changing the authority granted, leadership should look beyond average performance to sustained outcome quality, realized business value, exception behavior, reliable escalation and evidence appropriate to the new permissions and their potential consequences.

That evidence may support widening, holding, redesigning or narrowing the mandate.

The Autonomy Mandate

A policy sets the general rules.

The mandate translates those rules into permissions, limits and accountability for a specific workflow.

An Autonomy Mandate makes that decision explicit.

Exhibit 3 · Illustrative workflow decision

The Autonomy Mandate

A practical decision record for defining what the workflow may do, what remains retained and what evidence would justify expansion.

WorkflowVerified order-status service
Current decisionBounded automation
Decision ownerCustomer-service executive
01
Business value

Reduce handling time for verified order-status requests while preserving service quality.

02
Delegated authority

Retrieve approved order data and send routine status updates only to verified customer contacts within defined response rules.

03
Retained limits

No refunds, credits, cancellations, contract changes, policy exceptions or changes to customer records.

04
Human escalation

Route identity uncertainty, conflicting records, customer disputes and out-of-policy requests.

05
Accountable owner

The designated customer-service executive owns the mandate, controls and operating outcomes.

06
Evidence to scale

Exception patterns, override rates, customer impact and control performance must support any expansion.

Permitted nowVerified routine status responses
RetainedFinancial and policy-changing actions
EscalateAmbiguous, disputed or out-of-policy cases
Steering-committee decision ruleExpand authority only when evidence matches the consequence being delegated.

The instrument is not a target for maximum or minimum autonomy. It records the level of delegation justified now and the evidence that would support changing it.

Why the Tail Matters

Tail behavior determines where leadership should place review, controls and retained authority. Low-severity failures can become material at volume; a rare high-severity event can dominate otherwise attractive economics.

The management task is to distinguish consequences that can be absorbed or reversed from those that should remain outside the mandate.

The operating model for agentic scale

Once organizations delegate authority across multiple AI-enabled workflows, case-by-case mandates need a consistent management home.

Leaders need a repeatable way to prioritize use cases, assign owners, review outcomes and exceptions, and decide whether each mandate should widen, hold, be redesigned or narrow.

That management cadence is the operating-model question for agentic scale. It connects workflow-level decisions without turning them back into isolated technology experiments.

What the Meter Cannot See

Parts I and II followed the economics upward. First, from the unit being consumed to the outcome being produced. Then from the cost of the unit to the amount of activity that successful adoption can create.

Part III adds a third dimension: the distribution of outcomes under a defined scope of authority. Average performance alone cannot price the consequences hidden in exceptions.

That is what the meter cannot see.

For CFOs and operating leaders, the business case therefore has to connect unit economics and adoption to delegated authority, retained limits and the evidence required to change either.

What leadership should decide

Match authority to evidence and consequence.

Make the expected value, delegated permission, retained limits, escalation path, accountable owner and evidence for change explicit for each workflow.

Discuss the implications