GPTCache
megabots
GPTCache | megabots | |
---|---|---|
43 | 16 | |
6,446 | 334 | |
2.1% | - | |
7.7 | 6.9 | |
about 1 month ago | 11 months ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
GPTCache
-
Ask HN: What are the drawbacks of caching LLM responses?
Just found this: https://github.com/zilliztech/GPTCache which seems to address this idea/issue.
-
Open Source Advent Fun Wraps Up!
21. GPTCache | Github | tutorial
- Semantic Cache
-
Show HN: Danswer – open-source question answering across all your docs
Check this out. Built on a vector database (https://github.com/milvus-io/milvus) and a semantic cache (https://github.com/zilliztech/GPTCache)
https://osschat.io/
- GPTCache
-
Ask HN: Is LLM Caching Necessary?
With the proliferation of large models, an increasing number of enterprises and individual developers are now developing applications based on these models. As such, it is worth considering whether large model caching is necessary during the development process.
Our project: https://github.com/zilliztech/GPTCache
-
Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 APIs
Maybe [GPTCache](https://github.com/zilliztech/GPTCache) can make it more attractive, because similar problems can be less expensive, and can also be responded to faster. Of course, the specific configuration needs to be based on real usage scenarios.
- Limited budget or machine resources, how to achieve a decent LLM experience?
megabots
- 🤖 Release 0.0.11 in Megabots | Memory and Vectorstores are live!
- Introducing :🤖 Megabots - State-of-the-art, production ready full-stack LLM apps made mega-easy with LangChain and FastAPI
- Introducing: 🤖 Megabots - State-of-the-art, production ready full-stack LLM apps made mega-easy with LangChain and FastAPI
- 🤖 Megabots - Version 0.0.9 released
What are some alternatives?
guardrails - Adding guardrails to large language models.
Baichuan-7B - A large-scale 7B pretraining language model developed by BaiChuan-Inc.
gorilla-cli - LLMs for your CLI
llmware - Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.
danswer - Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
SHREC2023-ANIMAR - Source codes of team TikTorch (1st place solution) for track 2 and 3 of the SHREC2023 Challenge
DB-GPT - AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents
snowChat - Chat snowflake database - Text to SQL
gpt4free - The official gpt4free repository | various collection of powerful language models
gpt4-pdf-chatbot-langchain - GPT4 & LangChain Chatbot for large PDF docs
sheetgpt - ChatGPT integration with Google Sheets
synthetic-data-generator - 🦄 Use GPT to generate and label data