hands-on-llms
MLSys-NYU-2022
hands-on-llms | MLSys-NYU-2022 | |
---|---|---|
1 | 9 | |
2,329 | 238 | |
- | - | |
8.7 | 10.0 | |
about 1 month ago | over 1 year ago | |
Jupyter Notebook | Jupyter Notebook | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
hands-on-llms
-
Where to start
There are 3 courses that I usually recommend to folks looking to get into MLE/MLOps that already have a technical background. The first is a higher-level look at the MLOps processes, common challenges and solutions, and other important project considerations. It's one of Andrew Ng's courses from Deep Learning AI but you can audit it for free if you don't need the certificate: - Machine Learning in Production For a more hands-on, in-depth tutorial, I'd recommend this course from NYU (free on GitHub), including slides, scripts, full-code homework: - Machine Learning Systems And the title basically says it all, but this is also a really good one: - Hands-on Train and Deploy ML Pau Labarta, who made that last course, actually has a series of good (free) hands-on courses on GitHub. If you're interested in getting started with LLMs (since every company in the world seems to be clamoring for them right now), this course just came out from Pau and Paul Iusztin: - Hands-on LLMs For LLMs I also like this DLAI course (that includes Prompt Engineering too): - Generative AI with LLMs It can also be helpful to start learning how to use MLOps tools and platforms. I'll suggest Comet because I work there and am most familiar with it (and also because it's a great tool). Cloud and DevOps skills are also helpful. Make sure you're comfortable with git. Make sure you're learning how to actually deploy your projects. Good luck! :)
MLSys-NYU-2022
-
Where to start
There are 3 courses that I usually recommend to folks looking to get into MLE/MLOps that already have a technical background. The first is a higher-level look at the MLOps processes, common challenges and solutions, and other important project considerations. It's one of Andrew Ng's courses from Deep Learning AI but you can audit it for free if you don't need the certificate: - Machine Learning in Production For a more hands-on, in-depth tutorial, I'd recommend this course from NYU (free on GitHub), including slides, scripts, full-code homework: - Machine Learning Systems And the title basically says it all, but this is also a really good one: - Hands-on Train and Deploy ML Pau Labarta, who made that last course, actually has a series of good (free) hands-on courses on GitHub. If you're interested in getting started with LLMs (since every company in the world seems to be clamoring for them right now), this course just came out from Pau and Paul Iusztin: - Hands-on LLMs For LLMs I also like this DLAI course (that includes Prompt Engineering too): - Generative AI with LLMs It can also be helpful to start learning how to use MLOps tools and platforms. I'll suggest Comet because I work there and am most familiar with it (and also because it's a great tool). Cloud and DevOps skills are also helpful. Make sure you're comfortable with git. Make sure you're learning how to actually deploy your projects. Good luck! :)
-
background in ML, how can I get into DS career as a mid 40's guy with a family?
- Machine Learning Systems And a new (but very promising-looking), free GitHub course from Pau Labarta:
-
YouTube channel on AI, ML, NLP and Computer Vision
For a more hands-on, in-depth tutorial, I'd recommend this course from NYU (free on GitHub), including slides, scripts, full-code homework: - Machine Learning Systems
-
Help regarding DS career choices
For a higher-level, more conceptual overview, Andrew Ng always has great courses on DeepLearning.ai (and they're free to audit if you don't officially need the certificate): - Machine Learning for Production For a more hands-on, in-depth tutorial, I'd recommend this course from NYU (free on GitHub), including slides, scripts, full-code homework: - Machine Learning Systems And a new (but very promising-looking), free GitHub course from Pau Labarta (looks like he's still filming some of the lecture videos, but the rest of the course is all there): - Hands-on Train and Deploy ML
-
Recommendation for MLOps resources
- Machine Learning Systems
-
[Advice] MLOps Course recommendations
MLSys 2022 is an online course with slides, homework and full coding examples at https://github.com/jacopotagliabue/MLSys-NYU-2022/tree/main .The second part is entirely on MLOps with Comet, Metaflow, etc.
- MLSys-NYU-2022: NEW Other Models - star count:100.0
What are some alternatives?
finetuned-qlora-falcon7b-medical - Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
hands-on-train-and-deploy-ml - Train and Deploy an ML REST API to predict crypto prices, in 10 steps
AutoGPTQ - An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
you-dont-need-a-bigger-boat - An end-to-end implementation of intent prediction with Metaflow and other cool tools
doc_chat_api - Create a production level scalable chat bot API to respond from the fed data
demo-fraud-detection-with-p2p - Exploring Neo4j and Graph Data Science for Fraud Detection
LLM-Finetuning-Hub - Toolkit for fine-tuning, ablating and unit-testing open-source LLMs. [Moved to: https://github.com/georgian-io/LLM-Finetuning-Toolkit]
post-modern-stack - Joining the modern data stack with the modern ML stack
Local-LLM-Langchain - Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and KoboldAI versions of the langchain notebooks with examples.
CASALIOY - ♾️ toolkit for air-gapped LLMs on consumer-grade hardware