Tokens and sampling
- A token is not always a word.
- A space split is a toy. Label it.
- Temperature is not a truth dial.
- Record temperature, max tokens, and the stop.
- Confirm a model card before you quote a window.
Sources and go deeper
- Vaswani and co-authors, Attention Is All You Need, 2017 paper last checked 2026-10
- Brown and co-authors, Language Models are Few-Shot Learners, 2020 paper last checked 2026-10
- Attention Is All You Need — Wikipedia wikipedia last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10