Local Alternatives of ChatGPT and Midjourney

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

I'm trying this and it sucks after an hour of playing around with it.

• serge

  40 5,535 9.8 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

I have not tried it myself yet, but I have put it on my to-do list for the near future, alongside the already mentioned GPT4all, but another project I came across on reddit is Serge: https://github.com/nsarrazin/serge

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

LLaMA, Pythia, RWKV, Flan-T5 (self-hosted), FlexGen

• lollms-webui

  7 3,801 9.9 Vue

  Lord of Large Language Models Web User Interface

  

• sd-webui-lobe-theme

  77 2,146 9.5 TypeScript

  🅰️ Lobe theme - The modern theme for stable diffusion webui, exquisite interface design, highly customizable UI, and efficiency boosting features.

  

• stable-diffusion-webui

  2,808 129,299 9.9 Python

  Stable Diffusion web UI

InvokaAI is an alternative to AUTOMATIC1111's stable-diffusion-webui as a front-end for Stable Diffusion and both should be able to run on a RTX4000. The base model aren't the easiest to get the best results, but you will find many alternatives models on https://civitai.com/ that can all be used with the webui.

• InvokeAI

  239 21,266 10.0 TypeScript

  InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multiple commercial products.

  

InvokaAI is an alternative to AUTOMATIC1111's stable-diffusion-webui as a front-end for Stable Diffusion and both should be able to run on a RTX4000. The base model aren't the easiest to get the best results, but you will find many alternatives models on https://civitai.com/ that can all be used with the webui.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• civitai

  639 5,606 10.0 TypeScript

  A repository of models, textual inversions, and more

  

InvokaAI is an alternative to AUTOMATIC1111's stable-diffusion-webui as a front-end for Stable Diffusion and both should be able to run on a RTX4000. The base model aren't the easiest to get the best results, but you will find many alternatives models on https://civitai.com/ that can all be used with the webui.

• Open-Assistant

  329 36,647 8.3 Python

  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

  

I believe open-assistant is able to be ran locally, but it’s currently still in an early phase. Probably best to wait a month or two more for it to get better.

• stable-diffusion-webui-docker

  58 6,013 6.3 Shell

  Easy Docker setup for Stable Diffusion with user-friendly UI

• stanford_alpaca

  108 28,761 2.0 Python

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

Yep, there are a lot of LLaMa models available, some are very good, but of course require more resources. Many of them are capable of taking on GPT-4. Stanford's Alpaca is the one I've mostly seen talked about, but I'm not sure if it is necessarily the best option.

• pythia

  7 2,041 7.8 Jupyter Notebook

  The hub for EleutherAI's work on interpretability and learning dynamics

  

LLaMA, Pythia, RWKV, Flan-T5 (self-hosted), FlexGen

• RWKV-LM

  84 11,619 8.8 Python

  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

LLaMA, Pythia, RWKV, Flan-T5 (self-hosted), FlexGen

• FlexGen

  39 8,999 3.0 Python

  Running large language models on a single GPU for throughput-oriented scenarios.

  

LLaMA, Pythia, RWKV, Flan-T5 (self-hosted), FlexGen

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project