What's the current state of actually free and open source LLMs?

• ChatRWKV

  28 9,276 8.3 Python

  ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

I feel compelled to summon /u/bo_peng here and to mention his work on RWKV. (See https://github.com/BlinkDL/ChatRWKV and related repos.)

• laion.ai

  25 101 8.6 HTML
  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• alpaca.cpp

  94 9,878 9.4 C

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

• gpt-neox

  52 6,556 9.0 Python

  An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

  

Doesn't gpt-neox 20b require like 40gb+ of VRAM? From their github repo the slim weights are 39GB and I think one of the devs has previously mentioned aiming for 48GB for inference.

Suggest a related project