Nvidia built a massive dual GPU to power models like ChatGPT

• text-generation-webui

  876 36,552 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

For the people on laptops or desktops, there’s already another tool called Dalai that runs the LLaMa and Alpaca models (up to 65B) on CPU and can run on M1 MacBooks (and other weaker machines - Mac, Windows, and Linux). And Oobabooga can run them on Nvidia GPUs. r/LocalLlama has more info on all this

• serge

  40 5,543 9.8 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• AlpacaChat

  1 95 3.0 C

  A Swift library that runs Alpaca prediction locally to implement ChatGPT like app on Apple platform devices.

Thanks to 4-bit quantization, you can already run Alpaca 7B (and presumably LLaMa 7B) on an iPhone with AlpacaChat, though it’s currently quite slow.

• dalai

  59 13,060 6.5 CSS

  The simplest way to run LLaMA on your local machine

For the people on laptops or desktops, there’s already another tool called Dalai that runs the LLaMa and Alpaca models (up to 65B) on CPU and can run on M1 MacBooks (and other weaker machines - Mac, Windows, and Linux). And Oobabooga can run them on Nvidia GPUs. r/LocalLlama has more info on all this

• stable-diffusion-webui

  2,808 129,975 9.9 Python

  Stable Diffusion web UI

ofc, and it takes 5 minutes to install(depends on your internet) https://github.com/AUTOMATIC1111/stable-diffusion-webui

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project