I've been working on Serge, a self-hosted alternative to ChatGPT. It's dockerized, easy to setup and it runs the models 100% locally. No remote API needed.

• serge

  40 5,535 9.8 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

this worked: git clone https://github.com/nsarrazin/serge.git && serge

• dalai

  59 13,044 6.5 CSS

  The simplest way to run LLaMA on your local machine

Just in time, i was trying to mess around with Dalai and the have a bit of a show stopper bug until the fix is merged https://github.com/cocktailpeanut/dalai/pull/223

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• text-generation-webui

  876 35,862 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Here's the link to it.

• Home Assistant

  1,411 68,508 10.0 Python

  :house_with_garden: Open source home automation that puts local control and privacy first.

  

Is this what is being discussed: https://www.home-assistant.io/

• ovos-core

  13 101 9.1 Python

  OpenVoiceOS Core, the FOSS Artificial Intelligence platform.

  

• LocalAI

  82 19,593 9.9 C++

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

feel free to have a look for inspiration https://github.com/go-skynet/llama-cli, and if I can help and you want to use llama as an API, and keep the model loaded in memory between calls just let me know!

Suggest a related project