Using llama.cpp, how to access API?

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • alpaca.http

    Locally run an Instruction-Tuned Chat-Style LLM

    • I think you want alpaca.http you can download it here https://github.com/Nuked88/alpaca.http

  • llamacpp-for-kobold

    Discontinued Port of Facebook's LLaMA model in C/C++ [Moved to: https://github.com/LostRuins/koboldcpp]

    • I am the creator of https://github.com/LostRuins/llamacpp-for-kobold . It runs a local http server serving a koboldai compatible api with a built in webui. Compatible with all llama.cpp and alpaca.cpp models.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts