OSIIX Library

Designing AI Agent Verification Scope Around Failure Cost

The number of checks alone does not tell us whether verification was appropriate.

Type
Case Study / Engineering Note
Author
mars70

1. Introduction

The number of checks alone does not tell us whether verification was appropriate. A broad audit before a small copy change can lengthen the path to implementation. At the same time, immediately before publication, it can be valuable to examine the candidate set broadly enough to confirm that it remains within the approved scope.

This article contrasts two cases recorded during work on the same website. In CASE A, verification scope expanded before a limited edit, and the work stopped without making the edit. In CASE B, the deployment target was narrowed before execution. The evidence strength differs between the two cases. They do not establish a general law; they provide a framework for thinking about the placement of verification.

2. What “task-to-verification scope mismatch” means

A task-to-verification scope mismatch exists when the breadth of verification targets or stopping points is out of proportion to the stage of operation, reversibility, blast radius, and failure cost of the task. The term does not treat extensive verification as a problem in itself. Conversely, verification can also be mismatched when necessary checks are missing at a boundary with a high failure cost.

The useful question is not whether the process was “cautious,” or how many checks it contained. It is whether verification capable of detecting a plausible failure was placed before the point where that failure could occur.

3. CASE A — Verification scope expanded before a small change

The request was limited to changing the Hero copy on the Japanese and English homepages. The boundary was also explicit: preserve the existing HTML structure, and do not change CSS, metadata, navigation, hrefs, or unrelated state.

The preceding audit expanded across site structure, Library, Projects, Tools, About, the sitemap, and the Hero HTML and CSS. It also covered live HTTP, canonical and hreflang markup, remote/live byte parity, the deployment path, and the runtime boundary of another function. The recovered complete chat output records CHANGED_FILES: None; the Hero implementation did not occur, and the audit stopped with Do not edit.

The UI displayed Worked for 17m 28s. This is treated only as a UI elapsed-time display. It is not identified as the net duration of the audit or as active processing time, and no time breakdown is available for the individual checks.

As an interpretation, verification scope can reasonably be described as relatively broad for the pre-edit stage of a highly reversible, text-only change. The evidence does not show that any individual check was unnecessary or wasteful, and the reason the scope expanded remains unverified.

Evidence: The Hero change instruction, the recovered complete site-state audit chat output, and preserved records documenting the evaluation boundary are consulted.

4. CASE B — Deployment scope was narrowed at the deployment boundary

CASE B is supported by preserved decision records. According to those records, deploy-all was not run following a recorded full-tree dry-run. Japanese and English Ransomware V2-related files were recorded as candidates outside the work-unit scope. The deployment target was then narrowed to public/index.html and public/en/index.html, and the limited deployment was subsequently recorded as LIVE_VALIDATED.

However, neither the raw full-tree dry-run log nor the raw scoped dry-run log was recovered. This article therefore does not directly verify the complete dry-run output. It cannot establish the full candidate list or what would have happened if the broader operation had been executed.

The supported statement is limited to this: in response to the preserved record concerning the dry-run, deploy-all was not run, and a decision was made to narrow deployment to two files. This records a reconsideration of scope at the deployment boundary. It does not establish that an accident was prevented or that the out-of-scope files would certainly have been published.

Evidence: The preserved scope decision and deployment result, the Ransomware V2 candidate observation, and records that the raw logs were not recovered are consulted.

5. Do not compare the two cases by verification volume alone

The following table is the article’s evaluation of CASE A and CASE B, not an inventory of observed facts. In particular, CASE B has limited support from a preserved decision record; it is not a case in which the raw dry-run logs were directly examined.

Evaluation axisCASE ACASE B
Task stageBefore editingBefore deployment
ReversibilityHigh; the local edit had not been madeHighly reversible before execution, but execution would affect public state
Blast radiusApproved JA/EN Hero copyDeployment candidates that could extend across the public tree
Failure costApplying incorrect wording or breaking the existing Hero structure. The approved scope was a local JA/EN changePossibility of including unapproved items in the public scope
Observed process outcomeStopped without editingThe record states that deploy-all was not run and the process changed to a two-file scope
Evidence strengthDirectly supported by the recovered complete chat outputSupported by a preserved decision record; raw dry-run logs are unavailable
Verification scope considered appropriateFocus on the target HTML, preservation of structure, and the exact diffReview the full deployment candidate set and constrain execution to approved paths

CASE A occurred before any change had been made. CASE B occurred immediately before an operation that would affect the public scope. Even when verification looks similar in breadth, the failures it can detect and the losses it can help avoid differ by stage.

6. Place verification according to risk

The following is a general design proposal based on the two cases, not a result directly established by the evidence (GENERAL DISCUSSION).

  • Before editing: The target or instruction may be misunderstood. Reversibility is high and the impact is local. Check the target paths, prohibitions, and existing diffs.
  • Before commit: Unrelated changes may be recorded in history. The work can still be corrected locally, but the entire commit candidate is in scope. Check the exact diff, changed paths, and the minimum necessary tests.
  • Before push: Incorrect history may be shared. A revert remains possible, but remote users may be affected. Check the parent commit, remote drift, commit contents, and push destination.
  • Before deployment: Unapproved items may enter the public scope. The operation can still be stopped before execution, but the blast radius is the public tree. Check deployment candidates, the write set, the dry-run, and the recovery method.
  • After deployment: Repository source and the public result may diverge. Recovery may remain possible, but public impact has already begun. Check the target URLs, content equality, and necessary non-regression conditions.

High-cost verification need not be duplicated at every gate. Scope deserves emphasis before editing, the diff before commit, deployment candidates and recoverability before deployment, and final state after deployment. The practical value of verification depends substantially on whether it can distinguish the failures that may occur at that gate.

7. What these cases do not establish

  • The raw full-tree and scoped dry-run logs for CASE B were not recovered.
  • The 17m 28s display has no breakdown by activity.
  • The reason verification scope expanded in CASE A is unverified.
  • Causality for accident prevention in CASE B is not established.
  • The evidence covers two cases from a single project.
  • Reproducibility across other AI agents or projects has not been tested.
  • The evidence cannot determine an optimal verification volume.

The records therefore do not support attributing the observed process behavior to context, prompts, a model update, an internal service change, server latency, or any other specific cause. This article addresses only the stage of operation and verification scope that can be distinguished from the surviving records.

8. Conclusion

A limited, highly reversible edit and a deployment operation that affects the public scope call for different verification scopes. Neither uniformly increasing nor uniformly reducing verification resolves that difference.

In practice, the relevant questions are the current stage of operation, how far the work can be reversed, who or what may be affected, and the loss associated with failure. Verification of the target, the diff, deployment candidates, and final state can then be placed at the corresponding boundaries. These two cases do not establish a general law, but they provide a starting point for designing the placement of verification rather than judging the process by verification volume alone.