Our great sponsors
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
I am the creator of AI Runner, an application that allows you to run Stable Diffusion and LLMs locally on your own hardware. It is built with pure python using PyQT6, Huggingface and many more libraries. The goal is to create a local AI Assistant that can run on local hardware.
Although the current compiled production version 2.2.0 is limited to Stable Diffusion, I have added LLM support and much more to the upcoming v3.0.0.
With it you can run chatbots, connect your camera and microphone to pull images and text for use with the chat bot (a work in progress) and much more.
I test heavily using a 2080s. Version 2.2.0 has also been tested with a 1080GTX and also runs on the CPU (albeit very slowly).
I'm using agents and tools for the bot as well, so you can make it do things like RAG, control the application, launch apps on your computer, generate prompts for stable diffusion and much more.
Additionally I have added text to speech (there are currently two options with various settings to choose from, SpeechT5 and Bark).
AI Runner is GPL 3.0 and uses pyinstaller to create a compiled version for Windows and Ubuntu, available here https://capsizegames.itch.io/ai-runner
Version 3.0.0 is still under development. I hope to launch within the next month or so, but if you'd like to get a pre-release preview you can install the latest version from master.
This is a passion project of mine that I've been working on since 2022. The upcoming version has been in development for around 7 months and during that time I got Covid and the flu which slowed me down by a little over a month.
If you have questions please don't hesitate to ask.