Evaluating Agents: Golden Sets, Judges, and Shadow Mode
Same input, different outputs. How to measure whether a nondeterministic system actually works, step by step as well as answer by answer.
Nov 4, 202613 min read0 reactions0 comments
Tag archive
Same input, different outputs. How to measure whether a nondeterministic system actually works, step by step as well as answer by answer.