Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge. Learn more →
Litellm Alternatives
Similar projects and alternatives to litellm
-
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
-
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
-
FLiPStackWeekly
FLiP Stack Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...
-
libsql
libSQL is a fork of SQLite that is both Open Source, and Open Contributions.
-
symmetric-ds
SymmetricDS is database replication and file synchronization software that is platform independent, web enabled, and database agnostic. It is designed to make bi-directional data replication fast, easy, and resilient. It scales to a large number of nodes and works in near real-time across WAN and LAN networks.
-
-
towhee
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
-
Sonar
Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
-
fluent-bit
Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows
-
-
-
-
-
chatgpt-retrieval-plugin
The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.
-
evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
-
LocalAI
:robot: Self-hosted, community-driven, local OpenAI compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. Free Open Source OpenAI alternative. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, gpt4all, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others
-
dify
One API for plugins and datasets, one interface for prompt engineering and visual operation, all for creating powerful AI applications.
-
-
ChainForge
An open-source visual programming environment for LLM experimentation and prompt evaluation.
-
promptfoo
Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.
-
awesome-data-temporality
A curated list to help you manage temporal data across many modalities 🚀.
-
Mergify
Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.
litellm reviews and mentions
-
I asked 60 LLMs a set of 20 questions
Here's the template I'm using - https://github.com/BerriAI/litellm/blob/5ca8b23e22139a4f49bd...
Anything I'm doing incorrectly?
-
Llama2 on Replicate faster than ChatGPT?
Ran some testing and discovered llama2 on replicate is faster than chatgpt!
Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua...
Are others seeing similar results?
- FLaNK Stack Weekly for 14 Aug 2023
-
Show HN: Open-source proxy server for Llama2, GPT-4, Claude2 with Logging,Cache
Hey @breckenedge yes it does! Exactly the same way as the openai-python sdk. Here's our code tutorial for it https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...
Hi @deet - Yes it is! This actually automatically stores the cost per query to the Supabase table - here's how: https://github.com/BerriAI/litellm/blob/80d77fed7123af222011...
If you have ideas for improvement - we'd love a ticket/PR!
*Update*: for those asking how to run self-hosted llama2, we just added the ollama integration.
Here's the tutorial - https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...
- Show HN: Litellm – simple library to standardize OpenAI, Cohere, Azure LLM I/O
-
A note from our sponsor - InfluxDB
www.influxdata.com | 24 Sep 2023
Stats
BerriAI/litellm is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of litellm is Python.