Docs › OpenAI Agents SDK with RunVouch
OpenAI Agents SDK with RunVouch
The Agents SDK stops a run at max_turns and raises. Everything below that limit, including a run that spent $30 calling the same function, is a normal completion.
On this page
How it runs on OpenAI Agents SDK
Around Runner.run() with the Python client; report each tool call from the run result's new items.
Store the key
An environment variable on the host that runs the script.
Wrap the job
import asyncio, runvouch
from agents import Agent, Runner
async def main():
res = None
with runvouch.vouch("morning-briefing",
evidence=lambda: {"briefing": len(res.final_output) > 300},
cost=lambda: res.context_wrapper.usage.total_tokens * 0.000004) as run: # your price per token
res = await Runner.run(agent, "Write today's briefing", max_turns=20)
for item in res.new_items:
if item.type == "tool_call_item":
run.tool(item.raw_item.name, {"args": item.raw_item.arguments})
asyncio.run(main())rv fails open: if RunVouch is unreachable the job still runs and you get one warning line.
Register the cadence and caps
rv agent nightly-report --cadence 24h --grace 30m --max-runtime 1h --evidence --cap-run-cost 2
Register the agent once, from anywhere with the key. Cadence is what turns a schedule that stopped into an alert; --evidence makes a run without evidence a failure; the caps pause the agent when it overspends.
What goes silent on OpenAI Agents SDK
- Tracing in the OpenAI dashboard is after the fact; the cost cap acts during the run.
- A final output that is an apology is a completed run; evidence is a length or a file, not a status.
What RunVouch detects
| Alert | What it means here |
|---|---|
| MISSED | cadence plus grace passed and no run started |
| FAILED | non-zero exit or a reported failure, with the stderr excerpt |
| NO_EVIDENCE | the run said ok but the file, URL or assertion you required is missing |
| STALLED | a run started and never ended within max runtime |
| RETRY_STORM | the same tool called with identical input many times in one run |
| BUDGET_RUN / BUDGET_DAY | cost cap crossed; the agent is paused until you resume it |
| DRIFT | duration or output size far off its 7-run baseline |
Need a key? Get a free key · Stuck? contact