Selfhosted AI

• KoboldAI-Client

  185 3,344 6.3 Python

As of late, I have been playing around with these two in particular: - InvokeAI - Stable Diffusion based toolkit to generate images on your own system. It has grown quite a lot and has some intriguing features - they are even working on streamlining the training process with Dreambooth, which ought to be super interesting! - KoboldAI runs GPT2 and GPT-J based models. Its like a "primitive version" of ChatGPT (GPT3). But, its not incapable either. Model selection is great and you can load your own too, meaning that you could find some interesting ones on HuggingFace.

• whisper

  343 60,303 6.4 Python

  Robust Speech Recognition via Large-Scale Weak Supervision

  

I tried using Whisper to make subtitles for my videos but kept getting weird results. I'll have to try it again sometime to see if I can get it working properly.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• mycroft-core

  212 6,452 0.0 Python

  Mycroft Core, the Mycroft Artificial Intelligence platform.

  

I haven't looked at it recently, but the Mycroft AI virtual assistant project is based on FOSS, self-contained software. I used to have it running on a spare laptop at home. It might be suitable for self-hosted AI experimentation.

• stable-diffusion-webui

  2,808 129,299 9.9 Python

  Stable Diffusion web UI

• chaiNNer

  46 4,029 9.8 Python

  A node-based image processing GUI aimed at making chaining image processing tasks easy and customizable. Born as an AI upscaling application, chaiNNer has grown into an extremely flexible and powerful programmatic image processing application.

  

chaiNNer supports AI models.

• CodeProject.AI-Server

  6 518 6.5 Python

  CodeProject SenseAI is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.

  

I use CodeProject AI for my BlueIris setup. Works great. No false alarms.

• stable-diffusion-ui

  249 6,808 9.9 JavaScript

  Discontinued Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image. [Moved to: https://github.com/easydiffusion/easydiffusion]

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• IOPaint

  48 17,095 9.4 Python

  Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase and replace(powered by stable diffusion) any thing on your pictures.

LaMa-cleaner to remove objects/people from photos.

• whisper.cpp

  187 30,942 9.8 C

  Port of OpenAI's Whisper model in C/C++

Check Whisper.cpp as well, that is meant to be much more lightweight. Has a WASM demo as well.

• Open-Assistant

  329 36,622 9.1 Python

  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

  

Yeah, currently in development https://github.com/LAION-AI/Open-Assistant

• dream-factory

  17 469 8.7 Python

  Multi-threaded GUI manager for mass creation of AI-generated art with support for multiple GPUs.

• FlexGen

  39 8,999 3.0 Python

  Running large language models on a single GPU for throughput-oriented scenarios.

  

Checkout https://github.com/FMInference/FlexGen - there's a useful HN discussion on it recently that i'm having trouble finding :/

• text-generation-webui

  876 35,862 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

I am running https://github.com/oobabooga/text-generation-webui locally paired with Pygmalion 6B parameter version on a 3060 12GB. (It must use 8-bit precision)

• DeepFaceLive

  55 13,912 8.4 Python

  Discontinued Real-time face swap for PC streaming or video calls

• petals

  98 8,661 8.5 Python

  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

  

The closest thing I've seen is Petals that let's you run Bloom, a large language model the size of GPT-3, by pooling your resources with others. It still needs a gpu from nvidia no older than pascal(gtx 1080 or similar) but some might be lucky enough to just have that laying around waiting for a use case.

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project