SaaSHub helps you find the best software and product alternatives Learn more →
Top 11 Python llm-framework Projects
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
edsl
Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs. (by expectedparrot)
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
-
-
Project mention: OpenAI: Streaming is now available in the Assistants API | news.ycombinator.com | 2024-03-14This was indeed true in the beginning, and I don’t know if this has changed. Inserting messages with Assistant role is crucial for many reasons, such as if you want to implement caching, or otherwise edit/compress a previous assistant response for cost or other reason.
At the time I implemented a work-around in Langroid[1]: since you can only insert a “user” role message, prepend the content with ASSISTANT: whenever you want it to be treated as an assistant role. This actually works as expected and I was able to do caching. I explained it in this forum:
https://community.openai.com/t/add-custom-roles-to-messages-...
[1] the Langroid code that adds a message with a given role, using this above “assistant spoofing trick”:
https://github.com/langroid/langroid/blob/main/langroid/agen...
We have recently added support to query data from SingleStore to our agent framework, LLMStack (https://github.com/trypromptly/LLMStack). Out of the box performance performance when prompting with just the table schemas is pretty good with GPT-4.
The more domain specific knowledge needed for queries, the harder it has gotten in general. We've had good success `teaching` the model different concepts in relation to the dataset and giving it example questions and queries greatly improved performance.
Project mention: Python package for administering surveys to LLMs | news.ycombinator.com | 2024-04-18
Project mention: Geniusrise – Wannabe Competitor to Vertex AI, Azure AI Studio and Bedrock | news.ycombinator.com | 2024-03-15
Project mention: Show HN: Geniusrise, a framework and ecosystem for AI agents | news.ycombinator.com | 2023-09-23## More Links
1. https://github.com/geniusrise/geniusrise - core framework
2. https://github.com/geniusrise/geniusrise-huggingface - hf modules
3. https://github.com/geniusrise/geniusrise-openai - openai modules
4. https://github.com/geniusrise/geniusrise-listeners - streaming data input
5. https://github.com/geniusrise/geniusrise-databases - database input
6. https://github.com/geniusrise/geniusrise-prompt-actions - functional integrations (RAG-able and GPT function call-able, WIP)
7. https://github.com/geniusrise/geniusrise-indexing - vectorizing for RAG usecases (WIP)
8. https://github.com/geniusrise/geniusrise-exit-proxy - cached LLM interface with MITM-auditing (WIP)
## Asides
I think the core framework can be AGPL but the modules must be MIT / Apachev2.
I really wanted to create an elaborate example in the guides but could not find time, - something like load and vectorize SNOMED-CT or UMLS and use it to NER / RAG EHR docs. Or maybe a usecase of doctor communicating to patient in another language (a major problem in India), with reverse translation verifying translated output using the KG. These kinds of stuff are soon to come. Or discourse segmentation for better chunking for RAG usecases.
I'm not sure if I should add cyberpunk-ed scientists as banner images. I tried with mathematicians like Voevodsky to Andre Joyal to John Baez, but couldn't. Actual geniuses tend to not be famous, hence SDXL fails I guess.
I plan to also write this framework in scala. The category-theorizing of neural networks is amazing!!! https://github.com/bgavran/Category_Theory_Machine_Learning. I hope Bartosz Milewski approves.
I love Alan Turing, but cuz of "The Chemical Basis of Morphogenesis". It introduced me to the wonderful world of complex systems. Hence, his image as banner.
I'm also working on a cli library called "isomorphic", wraps over argparse and provides cli, api, yaml, json interfaces.
Yes, gradio integration is also underway.
Finally, to huggingface.
Project mention: Show HN: Geniusrise, a framework and ecosystem for AI agents | news.ycombinator.com | 2023-09-23## More Links
1. https://github.com/geniusrise/geniusrise - core framework
2. https://github.com/geniusrise/geniusrise-huggingface - hf modules
3. https://github.com/geniusrise/geniusrise-openai - openai modules
4. https://github.com/geniusrise/geniusrise-listeners - streaming data input
5. https://github.com/geniusrise/geniusrise-databases - database input
6. https://github.com/geniusrise/geniusrise-prompt-actions - functional integrations (RAG-able and GPT function call-able, WIP)
7. https://github.com/geniusrise/geniusrise-indexing - vectorizing for RAG usecases (WIP)
8. https://github.com/geniusrise/geniusrise-exit-proxy - cached LLM interface with MITM-auditing (WIP)
## Asides
I think the core framework can be AGPL but the modules must be MIT / Apachev2.
I really wanted to create an elaborate example in the guides but could not find time, - something like load and vectorize SNOMED-CT or UMLS and use it to NER / RAG EHR docs. Or maybe a usecase of doctor communicating to patient in another language (a major problem in India), with reverse translation verifying translated output using the KG. These kinds of stuff are soon to come. Or discourse segmentation for better chunking for RAG usecases.
I'm not sure if I should add cyberpunk-ed scientists as banner images. I tried with mathematicians like Voevodsky to Andre Joyal to John Baez, but couldn't. Actual geniuses tend to not be famous, hence SDXL fails I guess.
I plan to also write this framework in scala. The category-theorizing of neural networks is amazing!!! https://github.com/bgavran/Category_Theory_Machine_Learning. I hope Bartosz Milewski approves.
I love Alan Turing, but cuz of "The Chemical Basis of Morphogenesis". It introduced me to the wonderful world of complex systems. Hence, his image as banner.
I'm also working on a cli library called "isomorphic", wraps over argparse and provides cli, api, yaml, json interfaces.
Yes, gradio integration is also underway.
Finally, to huggingface.
Project mention: Show HN: Geniusrise, a framework and ecosystem for AI agents | news.ycombinator.com | 2023-09-23## More Links
1. https://github.com/geniusrise/geniusrise - core framework
2. https://github.com/geniusrise/geniusrise-huggingface - hf modules
3. https://github.com/geniusrise/geniusrise-openai - openai modules
4. https://github.com/geniusrise/geniusrise-listeners - streaming data input
5. https://github.com/geniusrise/geniusrise-databases - database input
6. https://github.com/geniusrise/geniusrise-prompt-actions - functional integrations (RAG-able and GPT function call-able, WIP)
7. https://github.com/geniusrise/geniusrise-indexing - vectorizing for RAG usecases (WIP)
8. https://github.com/geniusrise/geniusrise-exit-proxy - cached LLM interface with MITM-auditing (WIP)
## Asides
I think the core framework can be AGPL but the modules must be MIT / Apachev2.
I really wanted to create an elaborate example in the guides but could not find time, - something like load and vectorize SNOMED-CT or UMLS and use it to NER / RAG EHR docs. Or maybe a usecase of doctor communicating to patient in another language (a major problem in India), with reverse translation verifying translated output using the KG. These kinds of stuff are soon to come. Or discourse segmentation for better chunking for RAG usecases.
I'm not sure if I should add cyberpunk-ed scientists as banner images. I tried with mathematicians like Voevodsky to Andre Joyal to John Baez, but couldn't. Actual geniuses tend to not be famous, hence SDXL fails I guess.
I plan to also write this framework in scala. The category-theorizing of neural networks is amazing!!! https://github.com/bgavran/Category_Theory_Machine_Learning. I hope Bartosz Milewski approves.
I love Alan Turing, but cuz of "The Chemical Basis of Morphogenesis". It introduced me to the wonderful world of complex systems. Hence, his image as banner.
I'm also working on a cli library called "isomorphic", wraps over argparse and provides cli, api, yaml, json interfaces.
Yes, gradio integration is also underway.
Finally, to huggingface.
Project mention: Show HN: Geniusrise, a framework and ecosystem for AI agents | news.ycombinator.com | 2023-09-23## More Links
1. https://github.com/geniusrise/geniusrise - core framework
2. https://github.com/geniusrise/geniusrise-huggingface - hf modules
3. https://github.com/geniusrise/geniusrise-openai - openai modules
4. https://github.com/geniusrise/geniusrise-listeners - streaming data input
5. https://github.com/geniusrise/geniusrise-databases - database input
6. https://github.com/geniusrise/geniusrise-prompt-actions - functional integrations (RAG-able and GPT function call-able, WIP)
7. https://github.com/geniusrise/geniusrise-indexing - vectorizing for RAG usecases (WIP)
8. https://github.com/geniusrise/geniusrise-exit-proxy - cached LLM interface with MITM-auditing (WIP)
## Asides
I think the core framework can be AGPL but the modules must be MIT / Apachev2.
I really wanted to create an elaborate example in the guides but could not find time, - something like load and vectorize SNOMED-CT or UMLS and use it to NER / RAG EHR docs. Or maybe a usecase of doctor communicating to patient in another language (a major problem in India), with reverse translation verifying translated output using the KG. These kinds of stuff are soon to come. Or discourse segmentation for better chunking for RAG usecases.
I'm not sure if I should add cyberpunk-ed scientists as banner images. I tried with mathematicians like Voevodsky to Andre Joyal to John Baez, but couldn't. Actual geniuses tend to not be famous, hence SDXL fails I guess.
I plan to also write this framework in scala. The category-theorizing of neural networks is amazing!!! https://github.com/bgavran/Category_Theory_Machine_Learning. I hope Bartosz Milewski approves.
I love Alan Turing, but cuz of "The Chemical Basis of Morphogenesis". It introduced me to the wonderful world of complex systems. Hence, his image as banner.
I'm also working on a cli library called "isomorphic", wraps over argparse and provides cli, api, yaml, json interfaces.
Yes, gradio integration is also underway.
Finally, to huggingface.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python llm-framework related posts
-
Show HN: Prompts as (WASM) Programs
-
LLM2SQL New Repo
-
Show HN: Geniusrise, a framework and ecosystem for AI agents
-
We built a self-hosted low-code platform to build LLM apps locally and open-sourced it
-
LLMStack: self-hosted low-code platform to build LLM apps locally with LocalAI support
-
LLMStack: a self-hosted low-code platform to build LLM apps locally
-
Teaching with AI
-
A note from our sponsor - SaaSHub
www.saashub.com | 13 May 2024
Index
What are some of the best open-source llm-framework projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | langroid | 1,594 |
| 2 | LLMStack | 1,140 |
| 3 | LLMCompiler | 1,097 |
| 4 | spelltest | 131 |
| 5 | edsl | 56 |
| 6 | geniusrise | 56 |
| 7 | sql-sidekick | 19 |
| 8 | geniusrise-prompt-actions | 3 |
| 9 | geniusrise-listeners | 2 |
| 10 | geniusrise-openai | 2 |
| 11 | geniusrise-databases | 2 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com