Articles
Writing from the builders
Illustrated walkthroughs, workshop notes, and project write-ups - attention math, KV Cache, and vector databases.
Attention Math: Query, Key, Value
Scaled dot-product attention with pen-and-paper numbers: build Q, K, V from I love AI, score, scale, softmax, mix Values - plus masks, multi-head, and gotchas.
AItransformersattention
KV Cache in LLMs
An illustrated walkthrough: prefill vs decode, toy Q·K scores, why attention recomputes Keys and Values, and how KV Cache stores and reuses them.
AILLMstransformers
Vector Database Illustrated
An illustrated walkthrough: index three sentences, run a query, and find the nearest neighbour - every cell is arithmetic you can follow on screen.
AIRAGvector databases