Prompting and evals · L1 · 15 min
A job, a shape, and a test
Learn in five minutes
- A wish is not a job. Name the reader and the done check.
- The shape is the output you will accept.
- The test fails the change when the shape breaks.
- One change at a time.
- Keep the previous prompt next to the new one.
Replace 'be helpful' with 'return three bullets a new learner can check'. The second one can fail a test. The first one cannot.
Visual
Rewrite one wish
- Start from 'make this better'.
- Write the reader: a learner opening the room.
- Write the shape: three bullets.
- Write the test: each bullet names a checkable act.
Quiz
Ecosystem
- Done check
- The condition that says the output is finished enough.
Sisters: JSON schema, Rubrics, Regression tests.
The same job-shape-test card works for chat, voice, and a tool result.
The capstone reuses this card.
Config
- Write the goal in one sentence.
- Name the input and the allowed output.
- Save the trace next to the result.
Troubleshooting
- The answer looks fluent and is wrong. Check whether a source passage actually contains the claim.
- The loop never stops. Set a step cap and stop when the tool result repeats.
Sources and go deeper
- Brown and co-authors, Language Models are Few-Shot Learners, 2020 paper last checked 2026-10
- Prompt engineering — Wikipedia wikipedia last checked 2026-10