Can someone explain why there isn't a good interface for the oobabooga api in langchain?

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

It's already merged https://github.com/oobabooga/text-generation-webui/pull/2320

• learn-langchain

  8 273 6.7 Python

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• AgentOoba

  10 172 7.8 Python

  An autonomous AI agent extension for Oobabooga's web ui

• GPTQ-for-LLaMa-API

  5 40 4.7 Python

  Provide a way to use the GPT-QLLama model as an API

oobabooga has to support way too many models, so making the whole thing unnecessarily complicated. If you have some development experience, maybe you would build your own API in a few lines of Python code. It's not hard if you build from scratch and learn along the way. I have built some example repositories for hosting GPTQ-related models. You can have a look at them. https://github.com/mzbac/GPTQ-for-LLaMa-API https://github.com/mzbac/gptq-cuda-api

• gptq-cuda-api

  2 19 3.9 Python

oobabooga has to support way too many models, so making the whole thing unnecessarily complicated. If you have some development experience, maybe you would build your own API in a few lines of Python code. It's not hard if you build from scratch and learn along the way. I have built some example repositories for hosting GPTQ-related models. You can have a look at them. https://github.com/mzbac/GPTQ-for-LLaMa-API https://github.com/mzbac/gptq-cuda-api

• koboldcpp

  180 3,749 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• guidance

  6 43 9.0 Jupyter Notebook

  A guidance language for controlling large language models. (by Maximilian-Winter)

Did you see that someone had ported guidance to llamacpp? I saw someone trying to make it happen with ooga but I don't think they are as far as the llamacpp guy got. https://github.com/Maximilian-Winter/guidance

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project