Project Timeless

Before the prompt, there was the architecture.

Large Language Model from Scratch.

Acknowledgments

Reference: Building a Large Language Model (From Scratch) by Sebastian Raschka.

Name		Name	Last commit message	Last commit date
sms_spam_collection		sms_spam_collection
.gitignore		.gitignore
Chapter 2 - Working with Text Data.ipynb		Chapter 2 - Working with Text Data.ipynb
Chapter 3 - Coding Attention Mechanisms.ipynb		Chapter 3 - Coding Attention Mechanisms.ipynb
Chapter 4 - Implementing a GPT model from scratch to generate text.ipynb		Chapter 4 - Implementing a GPT model from scratch to generate text.ipynb
Chapter 5 - Pretraining on Unlabeled Data.ipynb		Chapter 5 - Pretraining on Unlabeled Data.ipynb
Chapter 6 - Finetuning for Text Classification.ipynb		Chapter 6 - Finetuning for Text Classification.ipynb
Chapter 7 - Finetuning To Follow Instructions.ipynb		Chapter 7 - Finetuning To Follow Instructions.ipynb
CustomClasses.py		CustomClasses.py
FUNDING.yml		FUNDING.yml
LICENSE		LICENSE
README.md		README.md
gpt_download.py		gpt_download.py
instruction-data-with-response.json		instruction-data-with-response.json
instruction-data.json		instruction-data.json
requirements.txt		requirements.txt
sms_spam_collection.zip		sms_spam_collection.zip
test.csv		test.csv
the-verdict.txt		the-verdict.txt
train.csv		train.csv
validation.csv		validation.csv