An LLM playground you can run on your laptop

• text-generation-webui

  877 37,723 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

For purely local, I've been having fun with this setup: https://github.com/oobabooga/text-generation-webui

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• openplayground

  12 6,128 0.6 TypeScript

  An LLM playground you can run on your laptop

• llama.cpp

  794 60,282 10.0 C++

  LLM inference in C/C++

GPT2 is ancient news. There are now local running models which, allegedly, can reach the same performance as GPT-4. Look up llama.cpp[1] and all the various community generated models.

[1] https://github.com/ggerganov/llama.cpp

• llamacpp-python

  3 197 6.6 C++

  Python bindings for llama.cpp

• awesome-ml

  27 1,508 8.4

  Curated list of useful LLM / Analytics / Datascience resources

Awesome! Does it support safetensors, new ggml format, triton or cuda model files?

I added the playground to the GUI list here:

to https://github.com/underlines/awesome-marketing-datascience/...

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project