Build a Large Language Model from Scratch
Developed a GPT-style large language model from scratch by following concepts and implementations from Build a Large Language Model (From Scratch) by Sebastian Raschka.
The project covers:
- Tokenization and embeddings
- Self-attention and multi-head attention
- Transformer blocks
- Training a GPT-style model
- Text generation
Technologies: Python, PyTorch, NLP, Transformers, LLMs