Prediction versus lookup
Write a private sentence on paper and do not type it.
Ask for that sentence's third word.
Treat any answer as ungrounded. Then type the sentence and ask again, and still check the words yourself.
Sources and go deeper
- Brown and co-authors, Language Models are Few-Shot Learners, 2020 paper last checked 2026-10
- Vaswani and co-authors, Attention Is All You Need, 2017 paper last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10
- Attention Is All You Need — Wikipedia wikipedia last checked 2026-10