minLoRA
fastai
| minLoRA | fastai | |
|---|---|---|
| 3 | 9 | |
| 392 | 25,665 | |
| - | 0.7% | |
| 2.4 | 8.0 | |
| 11 months ago | 17 days ago | |
| Jupyter Notebook | Jupyter Notebook | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
minLoRA
-
[D] Is it possible to train the same LLM instance on different users' data?
This repository seems to be doing it. Basically, you want to take the weights/biases that were trained during the LoRA training process and include them in the compute graph for the larger network, or remove them.
-
[P] minLoRA: An Easy-to-Use PyTorch Library for Applying LoRA to PyTorch Models
Theirs requires you to rewrite the whole model and replace every layer you want to apply LoRA to to the LoRA counterpart, or use monky-patching. Mine utilizes PyTorch parametrizations to inject the LoRA logic to existing models. If your model has nn.Linear, you can call add_lora(model) to add LoRA to all the linear layers. And it's not limited to Linear, you can see how I extended it to Embedding, Conv2d in a couple lines of code. https://github.com/cccntu/minLoRA/blob/main/minlora/model.py
fastai
-
Cleared AWS Machine Learning - Specialty exam.. Happy to help!!!
Jeremy Howard's YouTube Channel - Jeremy maintains the fastai library, which is an excellent package that will help anyone build complicated ML architectures in minimum time. His YouTube Channel has a number of free courses which do an amazing job of covering a variety of ML topics, and he also maintains a very active forum for people studying ML.
-
Coding your own AI in 2023 with fastai
To create the AI we will use fastai. This is a python library, which is build on top of pytorch. No worries, you don't need to know how to code python. We will learn how this stuff works along the way :)
-
Fast.ai starts a corporate partnership program
You may know fast.ai as a popular deep learning course. There is also a deep learning library with the same name (https://github.com/fastai/fastai) as well as software development tools like nbdev (https://nbdev.fast.ai/).
fast.ai has been offering education and tools for free for over 7 years, and has been approached by many companies asking for help. This program offers an avenue for business to get relevant professional services and support.
-
People tricking ChatGPT “like watching an Asimov novel come to life”
The "fastai" course is free, and does a really nice job walking you through building simple neural nets from the ground up:
https://github.com/fastai/fastai
What's going on here is the exact same thing, just much, much larger.
- Programação letrada com Jupyter Notebook e Nbdev
-
Why noone uses nbdev for library development?
Development NB: https://github.com/fastai/fastai/blob/master/nbs/09_vision.augment.ipynb
-
[D] What Repetitive Tasks Related to Machine Learning do You Hate Doing?
There is already a ton of momentum around automating ML workflows. I would suggest you contribute to a preexisting project like, for instance, PyTorch Lightning or fast.ai.
-
Good practices for neural network training: identify, save, and document best models
If you are unaware of what fastai is, its official description is:
-
D I Refuse To Use Pytorch Because Its A Facebook
Also, not a single docstring to document any code in the library - https://github.com/fastai/fastai/blob/master/fastai/vision/learner.py
What are some alternatives?
peft - 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
GTSRB - Convolutional Neural Network for German Traffic Sign Recognition Benchmark
fastbook - The fastai book, published as Jupyter Notebooks
Watermark-Removal-Pytorch - 🔥 CNN for Watermark Removal using Deep Image Prior with Pytorch 🔥.
PySyft - Perform data science on data that remains in someone else's server
lego-mindstorms - My LEGO MINDSTORMS projects (using set 51515 electronics)
ru-dalle - Generate images from texts. In Russian
pytorch-lightning - Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
iterative-grabcut - This algorithm uses a rectangle made by the user to identify the foreground item. Then, the user can edit to add or remove objects to the foreground. Then, it removes the background and makes it transparent.
catam-julia - CATAM material in Julia
adaptnlp - An easy to use Natural Language Processing library and framework for predicting, training, fine-tuning, and serving up state-of-the-art NLP models.