How to run something like chatgpt, locally?

• llama.cpp

  769 55,846 10.0 C++

  LLM inference in C/C++

You can run 13B parameter models on M1 very successfully. Check out llama.cpp repository: https://github.com/ggerganov/llama.cpp

• gpt4all

  139 64,046 9.8 C++

  gpt4all: run open-source LLMs anywhere

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• catai

  7 406 8.6 TypeScript

  UI for 🦙model . Run AI assistant locally ✨

  

Suggest a related project