SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python large-language-model Projects
-
gpt_academic
为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
-
Implementation: ORPO has been integrated into popular fine-tuning libraries like TRL, Axolotl, and LLaMA-Factory.
-
-
haystack
AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
Are you curious about the NLP/GenAI/RAG framework for developers? Check out my opinionated developer review of Haystack, which emerges as a robust NLP/RAG framework that excels in search and retrieval applications: Read the review.
-
-
Qwen
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
After logging in to Jozu Hub, you can grab any of the available ModelKits from their package registry. Start by unpacking the Qwen model from Jozu Hub.
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
Here’s another one - it’s older but has some interesting charts and graphs.
https://arxiv.org/abs/2303.18223
-
Project mention: LightRAG: Simple and Fast Retrieval-Augmented Generation | news.ycombinator.com | 2024-12-02
-
txtai
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
I fully agree. Postgres has solved many of the problems that many are re-solving with GenAI related databases.
With txtai (https://github.com/neuml/txtai), I've went all in with Postgres + pgvector. Projects can start small with a SQLite backend then switch the persistence to Postgres. With this, you get all the years of battle-tested production experience from Postgres built-in for free.
-
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Project mention: Serving AI from the Basement – 192GB of VRAM Setup | news.ycombinator.com | 2024-09-08 -
-
deeplake
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
Finally, we stored these vectors in our chosen database: the activeloop DeepLake database. This database is open source, something near and dear to our own open-source hearts. We will cover some additional details in a further section, but it is specifically designed to handle vector data and perform efficient similarity searches, which is crucial for quick and accurate retrieval during the RAG process.
-
-
camel
🐫 CAMEL: Finding the Scaling Law of Agents. The first and the best multi-agent framework. https://www.camel-ai.org (by camel-ai)
-
-
-
Qwen-VL
The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
-
awesome-pretrained-chinese-nlp-models
Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合
-
tree-of-thought-llm
[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models
-
Project mention: Pinecone integrates AI inferencing with vector database | news.ycombinator.com | 2024-12-04
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python large-language-models discussion
Python large-language-models related posts
-
Trillium TPU Is GA
-
LightRAG: Simple and Fast Retrieval-Augmented Generation
-
textGrad: Automatic “Differentiation” via Text
-
Manage Permissions in a Langflow Chain for LLM Queries using Permit.io
-
Hertz-dev, the first open-source base model for conversational audio
-
Are there any debugging tools similar to Jupyter available now?
-
Pax: A Jax-based machine learning framework for training large scale models
-
A note from our sponsor - SaaSHub
www.saashub.com | 12 Dec 2024
Index
What are some of the best open-source large-language-model projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | gpt_academic | 66,185 |
| 2 | LLaMA-Factory | 35,732 |
| 3 | Chinese-LLaMA-Alpaca | 18,498 |
| 4 | haystack | 18,001 |
| 5 | ChatGLM2-6B | 15,733 |
| 6 | Qwen | 14,678 |
| 7 | MOSS | 11,980 |
| 8 | ml-engineering | 11,934 |
| 9 | LLMSurvey | 10,586 |
| 10 | LightRAG | 11,127 |
| 11 | txtai | 9,605 |
| 12 | petals | 9,281 |
| 13 | optimate | 8,377 |
| 14 | deeplake | 8,220 |
| 15 | PentestGPT | 7,347 |
| 16 | camel | 5,792 |
| 17 | Baichuan-7B | 5,675 |
| 18 | openchat | 5,269 |
| 19 | Qwen-VL | 5,170 |
| 20 | awesome-pretrained-chinese-nlp-models | 4,949 |
| 21 | tree-of-thought-llm | 4,889 |
| 22 | marqo | 4,672 |
| 23 | AutoGPTQ | 4,549 |
Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai