Show HN: I made an app to use local AI as daily driver

• koboldcpp

  180 3,749 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• llamafile

  34 13,765 9.6 C++

  Distribute and run LLMs with a single file.

  

have you seen llamafile[0]?

[0] https://github.com/Mozilla-Ocho/llamafile

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• jan

  14 16,931 10.0 TypeScript

  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

  

It would be cool to have the option to use the OpenAI API as well in the same interface. http://jan.ai does this, so that's what I'm using at the moment.

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• open-webui

  7 16,677 10.0 Svelte

  User-friendly WebUI for LLMs (Formerly Ollama WebUI)

  

Add Open-WebUI (used to be Ollama-WebUI)

https://github.com/open-webui/open-webui

a well featured UI with very active team

• prompta

  3 132 9.0 Svelte

  ChatGPT UI that is keyboard-centric, mobile friendly, and search past conversations.

You could try out Prompta [1], which I made for this use case. Initially created to use OpenAI as a desktop app, but can use any compatible API including Ollama if you want local completions.

[1]: https://github.com/iansinnott/prompta

• serge

  40 5,535 9.8 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• ollama

  192 58,943 9.9 Go

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• gpt4all

  139 64,046 9.8 C++

  gpt4all: run open-source LLMs anywhere

  

• danswer

  27 9,138 9.9 Python

  Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

  

There are already several RAG chat open source solutions available. Two that immediately come to mind are:

Danswer

https://github.com/danswer-ai/danswer

Khoj

https://github.com/khoj-ai/khoj

• khoj

  50 4,786 9.9 Python

  Your AI second brain. A copilot to get answers to your questions, whether they be from your own notes or from the internet. Use powerful, online (e.g gpt4) or private, local (e.g mistral) LLMs. Self-host locally or use our web app. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

  

There are already several RAG chat open source solutions available. Two that immediately come to mind are:

Danswer

https://github.com/danswer-ai/danswer

Khoj

https://github.com/khoj-ai/khoj

• VOLlama

  1 13 8.8 Python

  An accessible chat client for Ollama

There's another one someone made for blind users like themselves and me, called Vollama (they use a mac, so VoiceOver + Llama). It's really good. I haven't tested many others for accessibility, but it has RAG and uses Ollama as backend, so works very well for me.

https://github.com/chigkim/VOLlama/

• llm

  23 2,903 9.5 Python

  Access large language models from the command-line (by simonw)

• chatbot-ui

  63 26,190 9.4 TypeScript

  AI chat for every model.

Thank you for the work.

Please take this in a nice way: I can't see why I would use this over ChatbotUI+Ollama https://github.com/mckaywrigley/chatbot-ui

Seem the only advantage is having it as MacOS native app and only real distinction is maybe fast import and search - I've yet to try that though.

ChatbotUI (and other similar stuff) are cross-platform, customizable, private, debuggable. I'm easily able to see what it's trying to do.

• private-gpt

  131 51,732 9.2 Python

  Interact with your documents using the power of GPT, 100% privately, no data leaks

  

• Lobe Chat

  6 28,579 9.9 TypeScript

  LobeChat is a open-source, extensible (Function Calling), high-performance chatbot framework.It supports one-click free deployment of your private ChatGPT/LLM web application.

  

• chat-ui

  40 5,980 9.7 TypeScript

  Open source codebase powering the HuggingChat app

  

- https://github.com/huggingface/chat-ui

• SillyTavern

  76 5,785 10.0 JavaScript

  LLM Frontend for Power Users.

  

• ollama-webui

  14 5,789 9.8 Svelte

  Discontinued ChatGPT-Style WebUI for LLMs (Formerly Ollama WebUI) [Moved to: https://github.com/open-webui/open-webui]

  

• chainlit

  7 5,401 9.7 TypeScript

  Build Conversational AI in minutes ⚡️

  

• lollms-webui

  7 3,762 9.9 Vue

  Lord of Large Language Models Web User Interface

  

• ComfyUI

  125 32,480 9.9 Python

  The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.

* LLaVA model: I'll add more documentation. You are right Llava could not generate images. For image generation I don't have immediate plans, but checkout these projects for local image generation.

- https://diffusionbee.com/

- https://github.com/comfyanonymous/ComfyUI

- https://github.com/AUTOMATIC1111/stable-diffusion-webui

• stable-diffusion-webui

  2,808 129,299 9.9 Python

  Stable Diffusion web UI

* LLaVA model: I'll add more documentation. You are right Llava could not generate images. For image generation I don't have immediate plans, but checkout these projects for local image generation.

- https://diffusionbee.com/

- https://github.com/comfyanonymous/ComfyUI

- https://github.com/AUTOMATIC1111/stable-diffusion-webui

• diffusionbee-stable-diffusion-ui

  141 11,911 4.4 JavaScript

  Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed.

* LLaVA model: I'll add more documentation. You are right Llava could not generate images. For image generation I don't have immediate plans, but checkout these projects for local image generation.

- https://diffusionbee.com/

- https://github.com/comfyanonymous/ComfyUI

- https://github.com/AUTOMATIC1111/stable-diffusion-webui

• astro

  503 42,342 10.0 TypeScript

  The web framework for content-driven websites. ⭐️ Star to support our work!

  

Thanks! honestly it's a quick hack together compared to the app. screenshots are from screen.studio. website is built with https://astro.build

• eimi

  1 2 5.1 Svelte

  Tree Comments / Threaded UI for ChatGPT | eimi.cns.wtf

I have a very simple UI with threading. It's really unpolished though.

https://eimi.cns.wtf/

https://github.com/python273/eimi

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project