Eval scorecard

One page. Print from the browser if you want paper. The PDF beside this file is the same text.

1. Same tasks. Version the file.
2. Quality: a pass rule you wrote before the run.
3. Safety: count failures. More is worse.
4. Latency and cost on the same card.
5. Compare to the baseline. A gate a person owns.