BaybGPT is a simple Decoder-Only Transformer model implemented in PyTorch. This project serves as a learning exercise to understand the inner workings of Decoder-Only Transformer architectures.
🔗 Code at github: https://github.com/v3xlrm1nOwo1/BaybGPT
Note:
Data was collected from Scanned Book containing poems by "Jalāl ad-Dīn Muhammad Rūmī" from the book "The Divan of Shams of Tabriz" using this code 🔗 Code at github: https://github.com/v3xlrm1nOwo1/GoogleTranslateOCRExtractTextFromPDF