Serge... Just works

• serge

  40 5,553 9.8 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

• fastLLaMa

  6 403 7.1 C

  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backend.

possible through fastllama in python or gpt-llama.cpp an API wrapper around llama.cpp

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• gpt-llama.cpp

  12 587 8.2 JavaScript

  A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI.

possible through fastllama in python or gpt-llama.cpp an API wrapper around llama.cpp

Suggest a related project