Back to blog

Building Production-Grade AI Agents · Part 9 of 15

Human Confirmation Without Confirmation Fatigue

User approval is useful, but it is not authorization—and asking “Are you sure?” before everything is not a product strategy.

Chris Eberl

Chris Eberl

Founder • Engineering Leader, GenAI, Data, ML

Production AI AgentsSep 14, 20264 min read
Human Confirmation Without Confirmation Fatigue

Human confirmation is one of the easiest safety controls to add to an agent, and one of the easiest to misuse. If every write produces a modal asking for approval, users stop reading. If no write requires approval, the system may create unwanted side effects. The solution is risk-based confirmation.

The most important distinction is that confirmation establishes intent. It does not grant authority. A user can say “yes” to an action that is still unauthorized or invalid.

System flow
1agent proposes action2        ↓3prepare action + deterministic validation4        ↓5persist pending_action_id6        ↓7user confirms intent8        ↓9revalidate current state + authorization10        ↓11execute idempotently

Risk-tier the action

Useful dimensions include reversibility, financial impact, external visibility, blast radius, privilege level, sensitivity, and recoverability. A reversible internal note may execute automatically after policy checks. A CRM stage change may require conditional confirmation. A financial transfer or external mass communication may always require explicit approval.

System flow
1LOW RISK2reversible + internal + small blast radius3→ deterministic checks → execute4 5MEDIUM RISK6visible or material but recoverable7→ conditional confirmation8 9HIGH RISK10financial / irreversible / privileged / broad audience11→ explicit confirmation or human approval

Reduce friction without weakening controls

Confirmation fatigue should be solved by moving mature decisions into explicit deterministic policy, not by letting the model auto-approve itself. You can batch related low-risk actions, give users narrow pre-authorization, or require confirmation only above thresholds. Historical data and evals can help tune those thresholds.

PFPLabs takeaways

  • User confirmation establishes intent; it does not grant authority.
  • Risk should drive confirmation policy.
  • Automate policy, not approval theater.
  • Revalidate before execution. State may change between proposal and confirmation.

Read next

Newsletter

New posts, straight from Chris

A short note from me whenever a new article goes live — product engineering, AI workflows, IoT, indie apps, and engineering leadership. No spam, unsubscribe anytime.

By subscribing, you agree to our Privacy Policy. We do not share your email.