Llama V2 is free to try on the AI Horde

• llama.cpp

  773 56,891 10.0 C++

  LLM inference in C/C++

Use instruct mode, with the instruction in the memory window, with the formatting discussed here: https://github.com/ggerganov/llama.cpp/issues/2262#issuecomm...

If you are feeling generous, host a V2 worker using KoboldCPP. Its pretty easy to set up, and 13B/70B will run on PCs with modest GPUs:

https://github.com/db0/KoboldAI-Horde-Bridge

• KoboldAI-Horde-Bridge

  6 31 10.0 Python

  Discontinued Turns KoboldAI into a crowdsourced distributed cluster

Use instruct mode, with the instruction in the memory window, with the formatting discussed here: https://github.com/ggerganov/llama.cpp/issues/2262#issuecomm...

If you are feeling generous, host a V2 worker using KoboldCPP. Its pretty easy to set up, and 13B/70B will run on PCs with modest GPUs:

https://github.com/db0/KoboldAI-Horde-Bridge

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project