T11-R4 in five minutes
Keep a fixed set of lines you are allowed to use: a script you wrote, not a customer tape.
Score the transcript against the script. A wrong name is a miss even when the sentence sounds kind.
Score the handoff packet: channel, what was said, note id, open question.
Score the refusal: a missing fact stays missing.
LiveKit's pipeline page says every stage of a cascaded pipeline produces text or audio you can inspect, log, and audit. Save that trail, not only a feeling about the audio.
Three checks on one script are an evaluation. A single impressive sentence is not.
Sources and go deeper
- LiveKit Agents, Pipeline types vendor last checked 2026-10
- NIST AI Risk Management Framework spec last checked 2026-10