llm-api

Run any Large Language Model behind a unified API (by 1b5d)
Add to my DEV experience Suggest topics
Source Code
llm-api Reviews
Suggest alternative
Edit details
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Llm-api Alternatives

Similar projects and alternatives to llm-api

  • LocalAI

    83 llm-api VS LocalAI

    :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  • text-generation-inference

    29 llm-api VS text-generation-inference

    Large Language Model Text Generation Inference

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • litellm

    28 llm-api VS litellm

    Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

  • server

    24 llm-api VS server

    The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)

  • simpleaichat

    22 llm-api VS simpleaichat

    Python package for easily interfacing with chat apps, with robust features and minimal code complexity.

  • llm

    4 llm-api VS llm

    Use any LLM from the command line. (by snwfdhmp)

  • text-generation-webui

    876 llm-api VS text-generation-webui

    A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better llm-api alternative or higher similarity.
Suggest an alternative to llm-api

llm-api reviews and mentions

Posts with mentions or reviews of llm-api. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-12-09.
  • Is there any open source app to load a model and expose API like OpenAI?
    5 projects | /r/LocalLLaMA | 9 Dec 2023
    1b5d/llm-api: Run any Large Language Model behind a unified API (github.com)
  • Best local LLM software.
    3 projects | /r/LocalLLM | 16 Jun 2023
    Good question, and an open one. You could try HuggingFace to have a wide variety of options. What is your technical expertise level? If you’re comfortable with python, then HuggingFace might be easier, for JS you could check out https://github.com/snwfdhmp/llm — some models which pop up a lot around here are llama.cpp, https://erichartford.com/uncensored-models - you could try https://github.com/1b5d/llm-api or https://github.com/minimaxir/simpleaichat

Stats

Basic llm-api repo stats
2
145
6.6
6 months ago

1b5d/llm-api is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of llm-api is Python.

Popular Comparisons

  1. llm-api VS llm
  2. llm-api VS text-generation-webui
  3. llm-api VS simpleaichat

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com