Docs › OpenAI Agents SDK with RunVouch

OpenAI Agents SDK with RunVouch

The Agents SDK stops a run at max_turns and raises. Everything below that limit, including a run that spent $30 calling the same function, is a normal completion.

How it runs on OpenAI Agents SDK

Around Runner.run() with the Python client; report each tool call from the run result's new items.

Store the key

An environment variable on the host that runs the script.

Wrap the job

import asyncio, runvouch
from agents import Agent, Runner

async def main():
    res = None
    with runvouch.vouch("morning-briefing",
                        evidence=lambda: {"briefing": len(res.final_output) > 300},
                        cost=lambda: res.context_wrapper.usage.total_tokens * 0.000004) as run:   # your price per token
        res = await Runner.run(agent, "Write today's briefing", max_turns=20)
        for item in res.new_items:
            if item.type == "tool_call_item":
                run.tool(item.raw_item.name, {"args": item.raw_item.arguments})

asyncio.run(main())

rv fails open: if RunVouch is unreachable the job still runs and you get one warning line.

Register the cadence and caps

rv agent nightly-report --cadence 24h --grace 30m --max-runtime 1h --evidence --cap-run-cost 2

Register the agent once, from anywhere with the key. Cadence is what turns a schedule that stopped into an alert; --evidence makes a run without evidence a failure; the caps pause the agent when it overspends.

What goes silent on OpenAI Agents SDK

What RunVouch detects

AlertWhat it means here
MISSEDcadence plus grace passed and no run started
FAILEDnon-zero exit or a reported failure, with the stderr excerpt
NO_EVIDENCEthe run said ok but the file, URL or assertion you required is missing
STALLEDa run started and never ended within max runtime
RETRY_STORMthe same tool called with identical input many times in one run
BUDGET_RUN / BUDGET_DAYcost cap crossed; the agent is paused until you resume it
DRIFTduration or output size far off its 7-run baseline

Need a key? Get a free key · Stuck? contact