Llama-api-server Alternatives

Similar projects and alternatives to llama-api-server

guidance

89 12,248 9.5 Jupyter Notebook llama-api-server VS guidance

Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)
awesome-ml

27 1,402 8.8 llama-api-server VS awesome-ml

Curated list of useful LLM / Analytics / Datascience resources
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
lmql

30 3,320 9.5 Python llama-api-server VS lmql

A language for constraint-guided and efficient LLM programming.
basaran

22 1,281 10.0 Python llama-api-server VS basaran

Discontinued Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
OpenChat

13 5,052 9.5 JavaScript llama-api-server VS OpenChat

LLMs custom-chatbots console ⚡
NeMo-Guardrails

13 3,338 9.9 Python llama-api-server VS NeMo-Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
convostack

5 191 8.7 TypeScript llama-api-server VS convostack

Plug and play embeddable AI chatbot widget and backend deployment framework
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
simpleAI

11 319 7.3 Python llama-api-server VS simpleAI

An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.
rellm

7 486 5.0 Python llama-api-server VS rellm

Exact structure out of any language model completion.
gpt-jargon

2 219 7.7 Python llama-api-server VS gpt-jargon

Jargon is a natural language programming language specified and executed by LLMs like GPT-4.
magma-chat

4 202 8.4 Ruby llama-api-server VS magma-chat

Ruby on Rails 7-based ChatGPT Bot Platform
guidance

23 17,246 9.8 Jupyter Notebook llama-api-server VS guidance

A guidance language for controlling large language models.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better llama-api-server alternative or higher similarity.

Suggest an alternative to llama-api-server

llama-api-server reviews and mentions

Posts with mentions or reviews of llama-api-server. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-07.

Run and create custom ChatGPT-like bots with OpenChat
15 projects | news.ycombinator.com | 7 Jun 2023

Disclaimer: I am curating LLM-tools on github [1]
A few thoughts:
* allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3]
* look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index
* Don't use a single embedding per content item, use multiple to increase retrieval quality
1 https://github.com/underlines/awesome-marketing-datascience/...
2 https://github.com/hyperonym/basaran
3 https://github.com/iaalm/llama-api-server