npi
GPTCache
| npi | GPTCache | |
|---|---|---|
| 4 | 43 | |
| 144 | 6,595 | |
| 3.5% | 2.9% | |
| 9.7 | 7.7 | |
| 5 days ago | 2 months ago | |
| Python | Python | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
npi
GPTCache
-
Ask HN: What are the drawbacks of caching LLM responses?
Just found this: https://github.com/zilliztech/GPTCache which seems to address this idea/issue.
-
Open Source Advent Fun Wraps Up!
21. GPTCache | Github | tutorial
- Semantic Cache
-
Show HN: Danswer – open-source question answering across all your docs
Check this out. Built on a vector database (https://github.com/milvus-io/milvus) and a semantic cache (https://github.com/zilliztech/GPTCache)
https://osschat.io/
- GPTCache
-
Ask HN: Is LLM Caching Necessary?
With the proliferation of large models, an increasing number of enterprises and individual developers are now developing applications based on these models. As such, it is worth considering whether large model caching is necessary during the development process.
Our project: https://github.com/zilliztech/GPTCache
-
Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 APIs
Maybe [GPTCache](https://github.com/zilliztech/GPTCache) can make it more attractive, because similar problems can be less expensive, and can also be responded to faster. Of course, the specific configuration needs to be based on real usage scenarios.
- Limited budget or machine resources, how to achieve a decent LLM experience?
What are some alternatives?
xllm - 🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
guardrails - Adding guardrails to large language models.
Tiger - Neuralink for your AI Agents - LangChain - Autogen - CrewAI
gorilla-cli - LLMs for your CLI
llmflows - LLMFlows - Simple, Explicit and Transparent LLM Apps
danswer - Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
open-assistant-api - The Open Assistant API is a ready-to-use, open-source, self-hosted agent/gpts orchestration creation framework, supporting customized extensions for LLM, RAG, function call, and tools capabilities. It also supports seamless integration with the openai/langchain sdk.
DB-GPT - AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents
gpt4free - The official gpt4free repository | various collection of powerful language models
sheetgpt - ChatGPT integration with Google Sheets
openai-gpt4 - decentralising the Ai Industry, free gpt-4/3.5 scripts through several reverse engineered api's ( poe.com, phind.com, chat.openai.com, phind.com, writesonic.com, sqlchat.ai, t3nsor.com, you.com etc...) [Moved to: https://github.com/xtekky/gpt4free]
private-gpt - Interact with your documents using the power of GPT, 100% privately, no data leaks