Docs › AutoGen with RunVouch
AutoGen with RunVouch
Two AutoGen agents that keep agreeing to continue, or a tool that keeps failing and being retried by the assistant, look exactly like work until the bill arrives.
On this page
How it runs on AutoGen
Around the chat or team run with the Python client, reporting tool executions through run.tool().
Store the key
An environment variable wherever the script runs.
Wrap the job
import asyncio, runvouch
from autogen_agentchat.teams import RoundRobinGroupChat
async def main():
with runvouch.vouch("nightly-triage", evidence=lambda: {"labels": labels_applied > 0}) as run:
team = RoundRobinGroupChat([triager, verifier], max_turns=12)
result = await team.run(task="Triage new issues and apply labels")
for m in result.messages:
if getattr(m, "type", "") == "ToolCallExecutionEvent":
run.tool("tool", {"content": str(m.content)[:200]})
asyncio.run(main())rv fails open: if RunVouch is unreachable the job still runs and you get one warning line.
Register the cadence and caps
rv agent nightly-report --cadence 24h --grace 30m --max-runtime 1h --evidence --cap-run-cost 2
Register the agent once, from anywhere with the key. Cadence is what turns a schedule that stopped into an alert; --evidence makes a run without evidence a failure; the caps pause the agent when it overspends.
What goes silent on AutoGen
max_turnsis a ceiling, not an alarm; hitting it every night is invisible without evidence.- Repeated identical tool executions are RETRY_STORM once reported.
What RunVouch detects
| Alert | What it means here |
|---|---|
| MISSED | cadence plus grace passed and no run started |
| FAILED | non-zero exit or a reported failure, with the stderr excerpt |
| NO_EVIDENCE | the run said ok but the file, URL or assertion you required is missing |
| STALLED | a run started and never ended within max runtime |
| RETRY_STORM | the same tool called with identical input many times in one run |
| BUDGET_RUN / BUDGET_DAY | cost cap crossed; the agent is paused until you resume it |
| DRIFT | duration or output size far off its 7-run baseline |
Need a key? Get a free key · Stuck? contact