T2-R1 quiz
What is a token? Answer: A unit the model actually reads. Words and tokens are not the same.
How should you treat a space split? Answer: As a labeled toy. The lab labels toy math as toy.
What paper is the usual transformer citation? Answer: Attention Is All You Need. Vaswani and co-authors, 2017.
Sources and go deeper
- Vaswani and co-authors, Attention Is All You Need, 2017 paper last checked 2026-10
- Brown and co-authors, Language Models are Few-Shot Learners, 2020 paper last checked 2026-10
- Attention Is All You Need — Wikipedia wikipedia last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10