Build Your GPT

Complete all ML problems and your solutions combine into a working GPT that generates text. You can also download all of your code as a single ZIP file.

Complete0%

Solved0/36

Free36

Your project

Every file matches a problem you solved. Green means the code is ready.

neetcode-gpt/

README.mdauto-generated
requirements.txtauto-generated
- normalization.pyLayer normalization
- batch_normalization.pyBatch normalization
- rms_normalization.pyRMS normalization
- embeddings.pyWord embeddings
- positional_encoding.pyPositional encoding
- attention.pySelf-attention head
- multi_head_attention.pyMulti-headed self-attention
- transformer.pyTransformer block
- gpt.pyGPT model
- kv_cache.pyKV-Cache for fast inference
- grouped_query_attention.pyGrouped query attention
train.pyGPT training loop
generate.pyText generation

Solve problems to build

Download what you have so far or push the project to GitHub.

Download Project

Get your GPT project as a ZIP (0/36 files)

Push to GitHub

Connect GitHub to push your project