litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs) (by BerriAI)

Litellm Alternatives

Similar projects and alternatives to litellm

  • llama.cpp

    LLM inference in C/C++

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • ollama

    Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.

  • whisper.cpp

    Port of OpenAI's Whisper model in C/C++

  • qdrant

    Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

  • gpt4all

    GPT4All: Chat with Local LLMs on Any Device

  • FastChat

    85 litellm VS FastChat

    An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  • LocalAI

    :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • FLiPStackWeekly

    FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...

  • fluent-bit

    Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows

  • libsql

    libSQL is a fork of SQLite that is both Open Source, and Open Contributions.

  • towhee

    26 litellm VS towhee

    Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

  • LibreChat

    24 litellm VS LibreChat

    Enhanced ChatGPT Clone: Features OpenAI, Assistants API, Azure, Groq, GPT-4 Vision, Mistral, Bing, Anthropic, OpenRouter, Vertex AI, Gemini, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development

  • ollama-webui

    Discontinued ChatGPT-Style WebUI for LLMs (Formerly Ollama WebUI) [Moved to: https://github.com/open-webui/open-webui]

  • symmetric-ds

    SymmetricDS is database replication and file synchronization software that is platform independent, web enabled, and database agnostic. It is designed to make bi-directional data replication fast, easy, and resilient. It scales to a large number of nodes and works in near real-time across WAN and LAN networks.

  • dify

    15 litellm VS dify

    Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

  • tokencost

    Easy token price estimates for 400+ LLMs. TokenOps.

  • text-generation-webui

    A Gradio web UI for Large Language Models.

  • anthropic-tokenizer

    Approximation of the Claude 3 tokenizer by inspecting generation stream

  • openai-messages-token-helper

    A utility library for dealing with token counting for messages sent to an LLM (currently OpenAI models only)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better litellm alternative or higher similarity.

litellm discussion

Log in or Post with

litellm reviews and mentions

Posts with mentions or reviews of litellm. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-06-17.

Stats

Basic litellm repo stats
30
10,560
10.0
4 days ago

Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com