Learn
Finish in 10 minutes
Read only these opening rooms, export one diagram, and stop.
- How this learning lab works — This site is a free learning lab about AI omni-channel agents.
- Tokens, not words — A model reads tokens, which may be parts of words.
- A job, a shape, and a test — A wish is not a job. Name the reader and the done check.
- Why retrieve — A model does not contain your private notes.
- An agent is a loop — An agent here means the model can choose a tool, see the result, and continue.
- The problem MCP names — Tools written for one app are hard to reuse in another.
- Omni-channel, for a learner — Omni-channel here means one assistant pattern that can meet a person on more than one channel.
- One GPU, then a cluster — A GPU is a processor often used for the matrix math in model training and serving.
- Speech in, a model, speech out — LiveKit's pipeline page names a cascaded pipeline: speech-to-text, then a language model, then text-to-speech.
- Transcription of a recording — Wikipedia defines speech analytics as analyzing recorded calls to gather customer information.
- Handoff to a person, not a software handoff — A handoff in this lab means a person continues the turn.
- Words for this ecosystem — Wikipedia defines speech analytics as analysis of recorded calls.
Short path HTMLShort path PDFShort path PNG
Sources and go deeper
- NIST AI Risk Management Framework spec last checked 2026-10
- W3C, Web Content Accessibility Guidelines 2.2 spec last checked 2026-10
- Web accessibility — Wikipedia wikipedia last checked 2026-10
- Vaswani and co-authors, Attention Is All You Need, 2017 paper last checked 2026-10
- Brown and co-authors, Language Models are Few-Shot Learners, 2020 paper last checked 2026-10
- Attention Is All You Need — Wikipedia wikipedia last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10
- Prompt engineering — Wikipedia wikipedia last checked 2026-10
- Lewis and co-authors, Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks, 2020 paper last checked 2026-10
- Retrieval-augmented generation — Wikipedia wikipedia last checked 2026-10
- Anthropic, Building effective agents vendor last checked 2026-10
- Yao and co-authors, ReAct: Synergizing Reasoning and Acting in Language Models, 2022 paper last checked 2026-10
- Model Context Protocol specification, 2025-06-18 spec last checked 2026-10
- What is the Model Context Protocol (MCP)? spec last checked 2026-10
- Model Context Protocol organization on GitHub community last checked 2026-10
- Model Context Protocol — Wikipedia wikipedia last checked 2026-10
- NVIDIA H100 GPU product page. Confirm any number before quoting it. vendor last checked 2026-10
- Graphics processing unit — Wikipedia wikipedia last checked 2026-10
- Hopper (microarchitecture) — Wikipedia wikipedia The H100 title redirects to the Hopper page. last checked 2026-10
- LiveKit Agents, Pipeline types vendor last checked 2026-10
- Pipecat open source framework vendor last checked 2026-10
- Voice Overview, docs.x.ai vendor The page calls them SpaceXSI Voice APIs, powered by Grok, and separates Speech to Speech, Text to Speech, and Speech to Text. last checked 2026-10
- Speech analytics — Wikipedia wikipedia last checked 2026-10
- Speech recognition — Wikipedia wikipedia last checked 2026-10
- Customer relationship management — Wikipedia wikipedia last checked 2026-10
- Workforce management — Wikipedia wikipedia last checked 2026-10
- Platform as a service — Wikipedia wikipedia That URL opened the Platform as a service article. The communications-platform section is on that page. last checked 2026-10
- FCC, Multi-line telephone systems: Kari’s Law and RAY BAUM’S Act spec The page says its timeline is not the full rule text. Educational reading, not legal advice. last checked 2026-10
Programming foundations
Files, HTTP, JSON, and a notebook you can re-run. No model call is required to start.
- How this learning lab works · L1 · 10 min
- Programs, files, and a notebook · L1 · 15 min
- Python values and functions · L1 · 20 min
- HTTP and JSON · L1 · 20 min
- Secrets stay out of the file · L1 · 15 min
- Tests and a small eval · L2 · 20 min
Sources and go deeper
- NIST AI Risk Management Framework spec last checked 2026-10
- W3C, Web Content Accessibility Guidelines 2.2 spec last checked 2026-10
- Web accessibility — Wikipedia wikipedia last checked 2026-10
- Python 3 tutorial vendor last checked 2026-10
- Python.org community community last checked 2026-10
- Git reference vendor last checked 2026-10
- Python (programming language) — Wikipedia wikipedia last checked 2026-10
- Git — Wikipedia wikipedia last checked 2026-10
- RFC 9110, HTTP Semantics spec last checked 2026-10
- RFC 8259, The JSON Data Interchange Format spec last checked 2026-10
- HTTP — Wikipedia wikipedia last checked 2026-10
- JSON — Wikipedia wikipedia last checked 2026-10
- OWASP Top 10 for Large Language Model Applications community last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10
Room files: T1-R1 sources.json · T1-R2 sources.json · T1-R3 sources.json · T1-R4 sources.json · T1-R5 sources.json · T1-R6 sources.json
How models work
Tokens, context, sampling, and why a fluent sentence can still be false.
- Tokens, not words · L1 · 15 min
- Next-token prediction · L1 · 15 min
- Context windows · L2 · 15 min
- Sampling · L2 · 15 min
- Hallucination · L2 · 15 min
- Model cards and ids · L2 · 15 min
Sources and go deeper
- Vaswani and co-authors, Attention Is All You Need, 2017 paper last checked 2026-10
- Brown and co-authors, Language Models are Few-Shot Learners, 2020 paper last checked 2026-10
- Attention Is All You Need — Wikipedia wikipedia last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10
- NIST AI Risk Management Framework spec last checked 2026-10
- OWASP Top 10 for Large Language Model Applications community last checked 2026-10
Room files: T2-R1 sources.json · T2-R2 sources.json · T2-R3 sources.json · T2-R4 sources.json · T2-R5 sources.json · T2-R6 sources.json
Prompting and evals
A job, a shape, and a test. Change one thing and keep the score.
- A job, a shape, and a test · L1 · 15 min
- Messages · L2 · 15 min
- Schemas · L2 · 20 min
- A golden set · L2 · 20 min
- Latency and a toy budget · L2 · 15 min
- Prompt diff · L2 · 15 min
Sources and go deeper
- Brown and co-authors, Language Models are Few-Shot Learners, 2020 paper last checked 2026-10
- Prompt engineering — Wikipedia wikipedia last checked 2026-10
- Anthropic, Building effective agents vendor last checked 2026-10
- Amazon Bedrock overview vendor last checked 2026-10
- RFC 8259, The JSON Data Interchange Format spec last checked 2026-10
- OWASP Top 10 for Large Language Model Applications community last checked 2026-10
- JSON — Wikipedia wikipedia last checked 2026-10
- Python 3 tutorial vendor last checked 2026-10
- NIST AI Risk Management Framework spec last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10
- Python (programming language) — Wikipedia wikipedia last checked 2026-10
Room files: T3-R1 sources.json · T3-R2 sources.json · T3-R3 sources.json · T3-R4 sources.json · T3-R5 sources.json · T3-R6 sources.json
Retrieval
Find a passage, then answer from it. Measure whether the passage was found.
- Why retrieve · L1 · 15 min
- Chunks · L2 · 15 min
- Embeddings · L2 · 20 min
- Retrieve, then read · L2 · 15 min
- Cite or refuse · L2 · 15 min
- Failure modes · L2 · 20 min
Sources and go deeper
- Lewis and co-authors, Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks, 2020 paper last checked 2026-10
- Retrieval-augmented generation — Wikipedia wikipedia last checked 2026-10
- Karpukhin and co-authors, Dense Passage Retrieval for Open-Domain Question Answering, 2020 paper last checked 2026-10
- Word embedding — Wikipedia wikipedia last checked 2026-10
- OWASP Top 10 for Large Language Model Applications community last checked 2026-10
Room files: T4-R1 sources.json · T4-R2 sources.json · T4-R3 sources.json · T4-R4 sources.json · T4-R5 sources.json · T4-R6 sources.json
Agents
A loop that may call a tool, with a schema, a step cap, and a trace.
- An agent is a loop · L1 · 15 min
- Tools and schemas · L2 · 20 min
- Step caps and traces · L2 · 15 min
- Human approval · L2 · 15 min
- ReAct, at learning depth · L2 · 20 min
- When not to use an agent · L2 · 15 min
Sources and go deeper
- Anthropic, Building effective agents vendor last checked 2026-10
- Yao and co-authors, ReAct: Synergizing Reasoning and Acting in Language Models, 2022 paper last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10
- Schick and co-authors, Toolformer: Language Models Can Teach Themselves to Use Tools, 2023 paper last checked 2026-10
- NIST AI Risk Management Framework spec last checked 2026-10
- OWASP Top 10 for Large Language Model Applications community last checked 2026-10
Room files: T5-R1 sources.json · T5-R2 sources.json · T5-R3 sources.json · T5-R4 sources.json · T5-R5 sources.json · T5-R6 sources.json
Model Context Protocol
A way for a host to talk to tool servers. Confirm the current specification before you build.
- The problem MCP names · L1 · 15 min
- Host, client, and server · L2 · 15 min
- Tools, resources, and prompts · L2 · 20 min
- Transports · L2 · 15 min
- Consent and roots · L2 · 20 min
- A notes server on paper · L3 · 25 min
Sources and go deeper
- Model Context Protocol specification, 2025-06-18 spec last checked 2026-10
- What is the Model Context Protocol (MCP)? spec last checked 2026-10
- Model Context Protocol organization on GitHub community last checked 2026-10
- Model Context Protocol — Wikipedia wikipedia last checked 2026-10
- RFC 9110, HTTP Semantics spec last checked 2026-10
- HTTP — Wikipedia wikipedia last checked 2026-10
- OWASP Top 10 for Large Language Model Applications community last checked 2026-10
- Lewis and co-authors, Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks, 2020 paper last checked 2026-10
- Retrieval-augmented generation — Wikipedia wikipedia last checked 2026-10
Room files: T6-R1 sources.json · T6-R2 sources.json · T6-R3 sources.json · T6-R4 sources.json · T6-R5 sources.json · T6-R6 sources.json
Voice and omni-channel agents
One learning model of voice, chat, and messaging, with a handoff to a person. Not a deployment claim.
- Omni-channel, for a learner · L1 · 15 min
- The voice loop · L2 · 20 min
- A latency budget you label as a lesson · L2 · 15 min
- Chat and messaging beside voice · L2 · 15 min
- Handoff to a person · L2 · 20 min
- What this lab will not claim · L1 · 10 min
Sources and go deeper
- NIST AI Risk Management Framework spec last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10
- MDN Web Docs, Web Speech API community last checked 2026-10
- Web Speech API community draft community last checked 2026-10
- W3C /TR/speech-api/ spec confirm This URL returned 404 on 2026-10. The community draft above is the page that opened. last checked 2026-10
- Speech synthesis — Wikipedia wikipedia last checked 2026-10
- Speech recognition — Wikipedia wikipedia last checked 2026-10
- Python 3 tutorial vendor last checked 2026-10
- Anthropic, Building effective agents vendor last checked 2026-10
- Creative Commons Attribution-NonCommercial-ShareAlike 4.0 spec last checked 2026-10
Room files: T7-R1 sources.json · T7-R2 sources.json · T7-R3 sources.json · T7-R4 sources.json · T7-R5 sources.json · T7-R6 sources.json
Compute, cloud, and a capstone
What a GPU cluster is for, how a cloud API differs, and a small grounded assistant you can actually finish.
- One GPU, then a cluster · L2 · 15 min
- Colossus as a public story · L2 · 15 min
- Cloud endpoints · L2 · 20 min
- Logs, regions, and data you may use · L2 · 15 min
- A one-page policy · L2 · 20 min
- Capstone and certifications · L3 · 25 min
Sources and go deeper
- NVIDIA H100 GPU product page. Confirm any number before quoting it. vendor last checked 2026-10
- Graphics processing unit — Wikipedia wikipedia last checked 2026-10
- Hopper (microarchitecture) — Wikipedia wikipedia The H100 title redirects to the Hopper page. last checked 2026-10
- xAI public site vendor confirm The site root returned 403 on 2026-10. last checked 2026-10
- Colossus supercomputer page on the xAI site vendor confirm This URL returned 403 on 2026-10, so it is not linked. last checked 2026-10
- Amazon Bedrock overview vendor last checked 2026-10
- Azure OpenAI documentation path vendor confirm On 2026-10 this URL opened a Microsoft Foundry models page, not a page titled Azure OpenAI. last checked 2026-10
- Vertex AI documentation path vendor confirm On 2026-10 this URL opened Gemini Enterprise Agent Platform docs, not a page titled Vertex AI. last checked 2026-10
- Cloud computing — Wikipedia wikipedia last checked 2026-10
- NIST AI Risk Management Framework spec last checked 2026-10
- OWASP Top 10 for Large Language Model Applications community last checked 2026-10
- Large language model — Wikipedia wikipedia last checked 2026-10
- Creative Commons Attribution-NonCommercial-ShareAlike 4.0 spec last checked 2026-10
Room files: T8-R1 sources.json · T8-R2 sources.json · T8-R3 sources.json · T8-R4 sources.json · T8-R5 sources.json · T8-R6 sources.json
Voice AI agent stack
Speech in, a model, speech out, and the network that carries the audio.
- Speech in, a model, speech out · L1 · 20 min
- Turn-taking and barge-in · L1 · 20 min
- Latency budgets you label · L2 · 15 min
- Telephony and WebRTC · L2 · 20 min
- LiveKit Agents and Pipecat · L2 · 20 min
- A hosted voice agent, from the xAI docs · L3 · 25 min
Sources and go deeper
- LiveKit Agents, Pipeline types vendor last checked 2026-10
- Pipecat open source framework vendor last checked 2026-10
- Voice Overview, docs.x.ai vendor The page calls them SpaceXSI Voice APIs, powered by Grok, and separates Speech to Speech, Text to Speech, and Speech to Text. last checked 2026-10
- LiveKit Agents, Turns overview vendor last checked 2026-10
- Speech to Speech, docs.x.ai vendor The page title is Speech to Speech. The body names the Grok Speech to Speech API and also calls the site SpaceXSI Docs. last checked 2026-10
- Python 3 tutorial vendor last checked 2026-10
- W3C, WebRTC Recommendation, 13 March 2025 spec last checked 2026-10
- WebRTC — Wikipedia wikipedia last checked 2026-10
- RFC 3261, SIP: Session Initiation Protocol spec last checked 2026-10
- Pipecat, Pipeline and frame processing vendor last checked 2026-10
Room files: T9-R1 sources.json · T9-R2 sources.json · T9-R3 sources.json · T9-R4 sources.json · T9-R5 sources.json · T9-R6 sources.json
Speech analytics and quality
Transcription, sentiment, a QA score, and redaction, with the pitfalls named.
- Transcription of a recording · L1 · 15 min
- Sentiment is a label · L2 · 15 min
- A QA score needs a rubric · L2 · 20 min
- Redaction · L2 · 20 min
- Pitfalls · L3 · 20 min
Sources and go deeper
- Speech analytics — Wikipedia wikipedia last checked 2026-10
- Speech recognition — Wikipedia wikipedia last checked 2026-10
- Sentiment analysis — Wikipedia wikipedia last checked 2026-10
- Personal data — Wikipedia wikipedia The page title is Personal data. last checked 2026-10
Room files: T10-R1 sources.json · T10-R2 sources.json · T10-R3 sources.json · T10-R4 sources.json · T10-R5 sources.json
AI agent safety
Handoff, guardrails, consent as education, and a test you can re-run.
- Handoff to a person, not a software handoff · L1 · 15 min
- Guardrails · L2 · 20 min
- Consent and recording, as education · L2 · 20 min
- Evaluation and testing · L2 · 20 min
- What this chapter will not claim · L3 · 15 min
Sources and go deeper
- Pipecat open source framework vendor last checked 2026-10
- NIST AI Risk Management Framework spec last checked 2026-10
- Anthropic, Building effective agents vendor last checked 2026-10
- OWASP Top 10 for Large Language Model Applications community last checked 2026-10
- Speech to Speech, docs.x.ai vendor The page title is Speech to Speech. The body names the Grok Speech to Speech API and also calls the site SpaceXSI Docs. last checked 2026-10
- 18 U.S.C. § 2511, Cornell Law School spec Educational reading of one federal section. Not legal advice, and not a survey of state law. last checked 2026-10
- LiveKit Agents, Pipeline types vendor last checked 2026-10
- Creative Commons Attribution-NonCommercial-ShareAlike 4.0 spec last checked 2026-10
Room files: T11-R1 sources.json · T11-R2 sources.json · T11-R3 sources.json · T11-R4 sources.json · T11-R5 sources.json
Contact-center ecosystem
A glossary, a mind map, sister systems, an integration map, bridges, and future hooks.
- Words for this ecosystem · L1 · 15 min
- A mind map · L1 · 15 min
- Sister technologies · L2 · 20 min
- An integration map · L2 · 20 min
- Bridges across platforms · L2 · 20 min
- Future hooks · L3 · 15 min
Sources and go deeper
- Speech analytics — Wikipedia wikipedia last checked 2026-10
- Customer relationship management — Wikipedia wikipedia last checked 2026-10
- Workforce management — Wikipedia wikipedia last checked 2026-10
- Platform as a service — Wikipedia wikipedia That URL opened the Platform as a service article. The communications-platform section is on that page. last checked 2026-10
- FCC, Multi-line telephone systems: Kari’s Law and RAY BAUM’S Act spec The page says its timeline is not the full rule text. Educational reading, not legal advice. last checked 2026-10
- NIST AI Risk Management Framework spec last checked 2026-10
- Speech to Speech, docs.x.ai vendor The page title is Speech to Speech. The body names the Grok Speech to Speech API and also calls the site SpaceXSI Docs. last checked 2026-10
- LiveKit Agents, Pipeline types vendor last checked 2026-10
- Pipecat, Pipeline and frame processing vendor last checked 2026-10
- Voice Overview, docs.x.ai vendor The page calls them SpaceXSI Voice APIs, powered by Grok, and separates Speech to Speech, Text to Speech, and Speech to Text. last checked 2026-10
Room files: T12-R1 sources.json · T12-R2 sources.json · T12-R3 sources.json · T12-R4 sources.json · T12-R5 sources.json · T12-R6 sources.json