Show HN: I made an app to use local AI as daily driver

• koboldcpp

  180 4,078 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• llamafile

  38 16,040 9.6 C++

  Distribute and run LLMs with a single file.

  

have you seen llamafile[0]?

[0] https://github.com/Mozilla-Ocho/llamafile

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• jan

  19 18,822 10.0 TypeScript

  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

  

It would be cool to have the option to use the OpenAI API as well in the same interface. http://jan.ai does this, so that's what I'm using at the moment.

• text-generation-webui

  877 37,401 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• open-webui

  10 25,041 10.0 Svelte

  User-friendly WebUI for LLMs (Formerly Ollama WebUI)

  

Add Open-WebUI (used to be Ollama-WebUI)

https://github.com/open-webui/open-webui

a well featured UI with very active team

• prompta

  3 139 8.5 Svelte

  ChatGPT UI that is keyboard-centric, mobile friendly, and search past conversations.

You could try out Prompta [1], which I made for this use case. Initially created to use OpenAI as a desktop app, but can use any compatible API including Ollama if you want local completions.

[1]: https://github.com/iansinnott/prompta

• serge

  40 5,576 9.8 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• ollama

  220 69,806 9.9 Go

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• gpt4all

  139 65,406 9.8 C++

  gpt4all: run open-source LLMs anywhere

  

• danswer

  28 9,511 9.9 Python

  Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

  

There are already several RAG chat open source solutions available. Two that immediately come to mind are:

Danswer

https://github.com/danswer-ai/danswer

Khoj

https://github.com/khoj-ai/khoj

• khoj

  50 10,579 9.9 Python

  Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

  

There are already several RAG chat open source solutions available. Two that immediately come to mind are:

Danswer

https://github.com/danswer-ai/danswer

Khoj

https://github.com/khoj-ai/khoj

• VOLlama

  1 17 9.0 Python

  An accessible chat client for Ollama

There's another one someone made for blind users like themselves and me, called Vollama (they use a mac, so VoiceOver + Llama). It's really good. I haven't tested many others for accessibility, but it has RAG and uses Ollama as backend, so works very well for me.

https://github.com/chigkim/VOLlama/

• llm

  27 3,189 9.4 Python

  Access large language models from the command-line (by simonw)

• chatbot-ui

  63 26,853 9.4 TypeScript

  AI chat for every model.

Thank you for the work.

Please take this in a nice way: I can't see why I would use this over ChatbotUI+Ollama https://github.com/mckaywrigley/chatbot-ui

Seem the only advantage is having it as MacOS native app and only real distinction is maybe fast import and search - I've yet to try that though.

ChatbotUI (and other similar stuff) are cross-platform, customizable, private, debuggable. I'm easily able to see what it's trying to do.

• private-gpt

  131 52,412 9.2 Python

  Interact with your documents using the power of GPT, 100% privately, no data leaks

  

• Lobe Chat

  6 31,722 9.9 TypeScript

  LobeChat is a open-source, extensible (Function Calling), high-performance chatbot framework.It supports one-click free deployment of your private ChatGPT/LLM web application.

  

• chat-ui

  40 6,499 9.8 TypeScript

  Open source codebase powering the HuggingChat app

  

- https://github.com/huggingface/chat-ui

• SillyTavern

  76 6,322 10.0 JavaScript

  LLM Frontend for Power Users.

  

• ollama-webui

  14 5,789 9.8 Svelte

  Discontinued ChatGPT-Style WebUI for LLMs (Formerly Ollama WebUI) [Moved to: https://github.com/open-webui/open-webui]

  

• chainlit

  7 5,763 9.7 TypeScript

  Build Conversational AI in minutes ⚡️

  

• lollms-webui

  7 3,924 9.9 Vue

  Lord of Large Language Models Web User Interface

  

• ComfyUI

  125 35,807 9.9 Python

  The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.

* LLaVA model: I'll add more documentation. You are right Llava could not generate images. For image generation I don't have immediate plans, but checkout these projects for local image generation.

- https://diffusionbee.com/

- https://github.com/comfyanonymous/ComfyUI

- https://github.com/AUTOMATIC1111/stable-diffusion-webui

• stable-diffusion-webui

  2,808 132,386 9.9 Python

  Stable Diffusion web UI

* LLaVA model: I'll add more documentation. You are right Llava could not generate images. For image generation I don't have immediate plans, but checkout these projects for local image generation.

- https://diffusionbee.com/

- https://github.com/comfyanonymous/ComfyUI

- https://github.com/AUTOMATIC1111/stable-diffusion-webui

• diffusionbee-stable-diffusion-ui

  141 11,999 4.4 JavaScript

  Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed.

* LLaVA model: I'll add more documentation. You are right Llava could not generate images. For image generation I don't have immediate plans, but checkout these projects for local image generation.

- https://diffusionbee.com/

- https://github.com/comfyanonymous/ComfyUI

- https://github.com/AUTOMATIC1111/stable-diffusion-webui

• astro

  508 43,154 10.0 TypeScript

  The web framework for content-driven websites. ⭐️ Star to support our work!

  

Thanks! honestly it's a quick hack together compared to the app. screenshots are from screen.studio. website is built with https://astro.build

• eimi

  1 2 5.1 Svelte

  Tree Comments / Threaded UI for ChatGPT | eimi.cns.wtf

I have a very simple UI with threading. It's really unpolished though.

https://eimi.cns.wtf/

https://github.com/python273/eimi

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project