1.6 KiB
1.6 KiB
Verifier Pro Kit
Catch agent mistakes before they hit production. Read-only verification.
Included Skills
- Verifier Builder — Two-agent observer pattern
- Confidence Ladder — PERFECT → FAILED grading
- Claim Decomposition — Break every claim into atomic units
- Read-Only Surface — Restrict to read/grep/find/ls
- Escalation Handler — Max 3 loops, then human
Architecture
Builder (your terminal) ──unix socket──► Verifier (new window, input LOCKED)
│ │
▼ writes: ▼ reads (read-only):
session.jsonl session.jsonl
│ │
◄──── verifier_prompt (corrective feedback) ──┘
The Confidence Ladder
| Level | Meaning | Bar Color |
|---|---|---|
| PERFECT | Every claim verified, zero gaps | Green |
| VERIFIED | All checks passed, minor gaps | Green |
| PARTIAL | No failures, significant unverifiable gaps | Orange |
| FEEDBACK | Claims failed, correction sent | Orange |
| FAILED | Cannot verify, escalating to human | Red |
Key Properties
- Builder DOES NOT KNOW verifier exists (pure observer)
- Verifier input is LOCKED (structurally un-promptable)
- Verifier has NO write tools (enforced at tool surface level)
- Max 3 correction loops, then escalate to human
Usage
# Start both agents
just verifier
# Builder prompts normally
# Verifier auto-runs after each builder turn
# If verification fails → corrective feedback sent
# After 3 failures → escalates to you