The code re-implement in Tensorflow for Build a Large Language Model (From Scratch)
Textbook: ISBN 978-1633437166
The book will give official torch code implemented by author
And the Project will implement the tensorflow alternative code.
Python 3.12
TensorFlow >= 2.16 for PyDataset | keras 3.3.0 (detail in keras-team/keras#20098 (comment))
If you want to get the dataset, please refer the repo the-verdict.