Local LLMs: After Novelty Wanes

• open-llms

  22 10,168 7.7

  📋 A list of open LLMs available for commercial use.

There's also MPT, which has a 7B, and Falcon, with a 7B and 40B although they have not had the inference tuning in community projects that the llamas have had. This is a good repo for reviewing what's available atm: https://github.com/eugeneyan/open-llms

• llama.cpp

  772 56,891 10.0 C++

  LLM inference in C/C++

Grammar based sampling is just one recent idea.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• lmql

  30 3,320 9.5 Python

  A language for constraint-guided and efficient LLM programming.

  

LMQL is another.

• SillyTavern

  76 5,930 10.0 JavaScript

  LLM Frontend for Power Users.

  

• SillyTavern-Extras

  14 481 9.6 Python

  Extensions API for SillyTavern.

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project