Benchmarks for LLMs on Consumer Hardware

• llm-experiments

  2 24 6.4 Python

  Experiments w/ ChatGPT, LangChain, local LLMs

  

I just spent $90 in OpenAPI credits to run the same `lm-harness` tests against `text-davinci-003` and it looks like it slots in between 13Bq8 and 30Bq4 on the test results: https://github.com/AUGMXNT/llm-experiments/blob/main/01-lm-eval.md

• alpaca.cpp

  94 9,878 9.4 C

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• supercharger

  13 346 6.6 Python

  Supercharge Open-Source AI Models

Here's the code that loads it: https://github.com/catid/supercharger/blob/main/server/model_koala.py

Suggest a related project