lil_gpt

A small decoder-only Transformer for experimentation and small-scale training with character-level tokenization.

Quick Start

• Install: pip install -r requirements.txt
• Configure: edit config.py to set hyperparameters and paths.
• Train: python train.py

Project Structure

• model.py — model architecture
• train.py — training loop and checkpoints
• config.py — training and model settings
• mobydick.txt — dataset I used because I love Moby Dick.
• requirements.txt — Python dependencies