Train Your Own LLM from Scratch

1. llm-from-scratch

   1 1 27 -

   

2. SaaSHub

   www.saashub.com sponsored

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. lectures

   2 1 2,940 - Python

   

4. LLMs-from-scratch

   3 38 102,543 8.5 Jupyter Notebook

   Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

   

   Coincidentally, I just started on Build a Large Language Model (From Scratch), a repo/book/course by Sebastian Raschka [0][1][2]. Maybe it is a good problem to have to have to decide which learning resource to use.

   [0] https://github.com/rasbt/LLMs-from-scratch

   [1] https://www.manning.com/books/build-a-large-language-model-f...

   [2] https://magazine.sebastianraschka.com/p/coding-llms-from-the...

5. DeepLearning-with-PyTorch-from-Scratch

   4 1 0 - Jupyter Notebook

   

   shameless plug:

   A series of Jupyter notebooks explaining the whole machine learning mechanism, from the beginning

   https://github.com/nickyreinert/DeepLearning-with-PyTorch-fr...

   and of course also how to build an llm from scratch

   https://github.com/nickyreinert/basic-llm-with-pytorch/blob/...

6. basic-llm-with-pytorch

   5 1 11 - Jupyter Notebook

   Basic implementation of Large Language Model in Pytorched (Revised free-code-camp example)

   

   shameless plug:

   A series of Jupyter notebooks explaining the whole machine learning mechanism, from the beginning

   https://github.com/nickyreinert/DeepLearning-with-PyTorch-fr...

   and of course also how to build an llm from scratch

   https://github.com/nickyreinert/basic-llm-with-pytorch/blob/...

Suggest a related project