My Adventures with LLM

This repository contains the code for all the chapters of My adventures with LLM book.

Setup

1. Install uv: https://docs.astral.sh/uv/getting-started/installation/

2. Create the uv environment:

uv sync

1. Activate the environment:

source .venv/bin/activate

1. Setup the environment variables. You will need a Hugging Face token to download the models.

cp .env.sample .env

Run the code

Specific chapters have their own README with instructions on how to run the code.

For example, to run the code for chapter 1, go to the ch1 folder and follow the instructions in the README.

Chapters

• Chapter 1: A Journey into the Heart of Transformers
• Chapter 2: LLMs are Unsupervised Multitask Learners
• Chapter 3: The Llama3 Herd of Models
• Chapter 4: KV Cache and Attention Mechanisms Evolution
• Chapter 5: DeepSeek - The Final Adventure