AI Engineering from Scratch
Curated by AI Engineering from Scratch • Added 2026-06-25
Build production AI systems from first principles across 500+ free lessons
AI Engineering from Scratch provides 523 open-source, hands-on lessons teaching you how to build tokenizers, embedding models, vector search indexes, LLM agent frameworks, and evaluation harnesses from fundamental first principles.
What You Will Learn
- ✓Building byte-pair encoding (BPE) tokenizers and dense vector embedding spaces from scratch
- ✓Implementing vector similarity search algorithms (HNSW, cosine indexes) without black-box databases
- ✓Constructing autonomous LLM agent execution loops, tool calling protocols, and state graphs
- ✓Designing statistical evaluation pipelines and synthetic benchmarks to measure hallucination rates
Curator Highlights
- ★523 comprehensive free lessons
- ★Zero black-box abstractions
- ★Production-grade system architectures
Related in AI & Machine Learning
Other vetted resources in this discipline
TrenTorch
AI & Machine Learning•Interactive
Build machine learning frameworks from scratch by hand
Fanout
AI & Machine Learning•Platform
Mapped technical learning across AI research, systems, and ML math
Inference Engineering
AI & Machine Learning•Guide
Deep-dive technical guide to LLM inference optimization & runtime mechanics
