LLM-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch following the book Build a Large Language Model (From Scratch).

This repository contains the code for developing, pretraining, and finetuning a GPT-like LLM.