Andrej Karpathy

Former Tesla AI director and OpenAI founding member. Known for building things from scratch — GPT, tokenizers, neural networks — in a way that makes the internals unmistakably clear.

Topics (26)

Agents & Reasoning

• Agent Fundamentals
• Agentic Coding
• Evaluation Benchmarks

Foundational AI

• Neural Networks
• Optimization Algorithms
• Tokenization
• Word Embeddings

Large Language Models

• Function Calling
• Inference Optimization
• Long Context Models
• LoRA & PEFT
• Pre-Training
• Prompting
• Reasoning Models
• RLHF & Alignment
• Scaling Laws
• Synthetic Data & Self-Improvement
• System Prompts

Multimodal AI

• Audio & Speech Models
• Video Understanding

Retrieval & Knowledge

• RAG & Retrieval

Sequence Models & Attention

• Attention Mechanism
• Multi-Head Attention
• RNNs & LSTMs
• Self-Attention
• Transformer Architecture