The maths you need to start understanding LLMs

1. thinking-in-tensors-writing-in-pytorch

   1 5 395 2.0 Jupyter Notebook

   Thinking in tensors, writing in PyTorch (a hands-on deep learning intro)

   

   Well, in short - basic linear algebra, basic probability, analysis (functions like exp), gradient.

   At some point I tried to create an introduction step-by-step, where people can interact with these concepts and see how to express it in PyTorch:

   https://github.com/stared/thinking-in-tensors-writing-in-pyt...

2. SaaSHub

   www.saashub.com sponsored

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. thinking-in-tensors-writing-in-pyt

   2 5 - -

   Well, in short - basic linear algebra, basic probability, analysis (functions like exp), gradient.

   At some point I tried to create an introduction step-by-step, where people can interact with these concepts and see how to express it in PyTorch:

   https://github.com/stared/thinking-in-tensors-writing-in-pyt...

4. Mathematics-for-Machine-Learning-and-Data-Science-Specialization-Coursera

   3 5 938 6.3 Jupyter Notebook

   Mathematics for Machine Learning and Data Science Specialization - Coursera - deeplearning.ai - solutions and notes

   

   I'm simultaneously working through the book Math and Architectures of Deep Learning, which is helping re-inforce and flesh out the ideas from the course.

   [0] https://www.coursera.org/specializations/mathematics-for-mac...

5. LLMs-from-scratch

   4 38 102,543 8.5 Jupyter Notebook

   Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

   

   Here is the code used in the book - https://github.com/rasbt/LLMs-from-scratch

Suggest a related project