docs(tac): add agent harness loop guidance
Capture the Sean's AI Stories loop-engineering video in the TAC meta-prompt. Require plans to name harness context, memory, guardrails, traces, evals, and promotion criteria, and lock those markers with pytest.
This commit is contained in:
parent
78cc1c1a05
commit
432282f186
|
|
@ -12,6 +12,10 @@ def test_loop_engineering_meta_prompt_locks_safety_fields():
|
||||||
"git-proxy:8099/deploy",
|
"git-proxy:8099/deploy",
|
||||||
"auto_patch_proven",
|
"auto_patch_proven",
|
||||||
"rsi_canary_recovery_evidence",
|
"rsi_canary_recovery_evidence",
|
||||||
|
"Agent harness",
|
||||||
|
"end-loop guardrails",
|
||||||
|
"latency, token use",
|
||||||
|
"YouTube `GrNbuWWJYiI`",
|
||||||
"Model Workspace Protocol",
|
"Model Workspace Protocol",
|
||||||
"00-intake/",
|
"00-intake/",
|
||||||
"40-ship/",
|
"40-ship/",
|
||||||
|
|
|
||||||
|
|
@ -34,6 +34,22 @@ At minimum, plans must name the checks that prove:
|
||||||
|
|
||||||
Prefer the boring loop that compounds over the clever prompt that works once. If the plan needs a new framework, first prove a markdown file, JSON receipt, and pytest assertion cannot hold the invariant.
|
Prefer the boring loop that compounds over the clever prompt that works once. If the plan needs a new framework, first prove a markdown file, JSON receipt, and pytest assertion cannot hold the invariant.
|
||||||
|
|
||||||
|
## Agent harness note
|
||||||
|
|
||||||
|
A loop is not just repeated model calls. Every agent plan must name the harness around the model:
|
||||||
|
|
||||||
|
- context and working memory;
|
||||||
|
- durable semantic memory / RAG sources;
|
||||||
|
- episodic memory / traces from prior runs;
|
||||||
|
- tool allowlist and signed deploy boundaries;
|
||||||
|
- end-loop guardrails that define when to stop;
|
||||||
|
- tracing for retrievals, tool calls, latency, token use, and errors;
|
||||||
|
- evals/receipts that decide whether prompt or config changes can feed back into the next run.
|
||||||
|
|
||||||
|
LLMOps/hill-climbing only promotes a changed prompt, retrieval config, tool config, or model parameter when traces plus evals show the new loop is safer or better.
|
||||||
|
|
||||||
|
Reference: Sean's AI Stories, "You Can Learn AI Agent Harness & Loop Engineering In 19 Min" (YouTube `GrNbuWWJYiI`).
|
||||||
|
|
||||||
## Model Workspace Protocol note
|
## Model Workspace Protocol note
|
||||||
|
|
||||||
For sequential workflows with human review between stages, prefer folder-structured orchestration before multi-agent framework code. The Model Workspace Protocol pattern treats numbered folders as stages, markdown files as role/context carriers, and local scripts as the boring mechanical layer.
|
For sequential workflows with human review between stages, prefer folder-structured orchestration before multi-agent framework code. The Model Workspace Protocol pattern treats numbered folders as stages, markdown files as role/context carriers, and local scripts as the boring mechanical layer.
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue