Golden Dataset

A hand-curated set of input/output pairs representing the correct behavior an AI agent should produce on important cases. Golden datasets serve as the authoritative baseline in evals: every prompt change, model upgrade, or new tool is tested against the golden set before shipping. Unlike synthetic test data, golden examples are vetted by subject-matter experts and updated whenever production reveals a new failure mode.