Index

These lectures introduce the core components of large language models, from tokenization and attention through pretraining and finetuning. They assume a basic understanding of machine learning, and the code is primarily tested in Google Colab.

• Tokenization

• Attention

• Architecture - GPT

• Pretraining

• Finetuning for Classification

• Finetuning to Follow Instructions