AI Explained

Language Models

Transformers, tokens, attention and how chatbots work.

LLMs

How Attention Works in Transformers: Queries, Keys and Values Explained

Attention lets each token weigh every other token when building its representation. Learn queries, keys, values, softmax weights and multi-head attention.

5 min read
LLMs

How Tokenization Works: Turning Text into Numbers for Language Models

Language models read tokens, not letters or words. Learn how byte pair encoding splits text into subword pieces and why tokens set cost and context size.

5 min read