Andrej Karpathy Explains How GPT Assistants Are Built

Recommended as the clearest overview of how LLM assistants are built and how to use them well.

Andrej Karpathy walks through how GPT assistants are trained, from tokenization and pretraining to supervised finetuning and RLHF, and gives practical prompting strategies and a view of the tooling ecosystem.