DrawBot VS airunner

AI Runner is an application I have been working on for well over a year. I am the only developer on the project. I currently do not have a job so I have treated this as my full-time job. 3.0 is not yet ready for release, but I wanted to show you some of the cool things I've done with it (see video in link or check out my youtube page for past progress updates https://www.youtube.com/@capsizegames4331).

AI Runner is a privacy-forward, multi-modal offline AI application built with Pyside6, huggingface libraries, llamaindex and open source models. It allows for real-time text to speech conversations with chatbot agents that you can fully customize. The bots have personalities and "moods". The moods shift with the conversation. I am using custom agents and my own system for selecting actions which is very fast.

The application also allows you to generate images using Stable Diffusion and controlnet (previous versions allowed Kandinsky), LLM for chatbots and RAG retrieval using Mistral 7b and T5, multi-lingual text-to-speech using speech-t5, bark and espeak.

The whole thing can run on a single 2080s video card, or you can split it between multiple GPUs by assigning models to available cards. For example, I have a 2080s which I use for Stable Diffusion, and a 3060 that I use for the other models.

I've built in lots of features such as drawing tools, RAG for documents and websites, image generation with the LLM or custom prompts and more. I post about it often on my Twitter acount (https://twitter.com/xw4ffl35x).

In addition to being a stand-alone application, the goal is to make it usable as an engine to power other applications. For example I plan to use it to power an RPG I am developing in Pygame.

The application is pure python and can be compiled with pyinstaller using the installation scripts included in the main repo (https://github.com/capsize-games/airunner).

I am currently working on v3.0.0 which is under heavy development and is not stable. The last stable version came out over 8 months ago and was version 2.2 (you can find it tagged on github).

This new version is a complete refactor and uses proper threading, has enhanced privacy and security features (the app is not able to access the internet and complete works around any security holes in the huggingface libraries by preventing them from accessing the internet or creating a .cache folder - there's more information about this in the README).

---

I believe it is crucially important to have open source options when it comes to AI. I do not want to live in a world that is dominated by OpenAI. I want free, open source models and the ability to run them locally, offline for free.

If you would like to support my efforts, please consider donating via patreon https://www.patreon.com/w4ffl35

AI Runner is an application that I have been developing for over a year. This next iteration is a near total rewrite and adds lots of new features - what started out as an AI Art application has evolved into a multi-modal AI assistant built with pure python. It runs locally and offline on your own hardware (I recommend using an RTX 2080s or higher).

You can get the source here: https://github.com/Capsize-Games/airunner/

Hi all, I've been working on this application for quite some time. It started out as a Stable Diffusion art app, and is now transitioning into a full featured AI assistant of sorts.

The video features me talking to the computer using my headphones. It records my speech, translates bytes to text, passes that to the LLM which generates text, and then uses another model for text to speech.

The video also shows me asking for an image at which point the LLM generates a prompt. Stable Diffusion is loaded and the prompt is passed to SD to generate the image.

The models I'm using:

- TTS: SpeechT5

- LLM: Mistral 7b

- Stable Diffusion: Turbo

- STT: whisper-tiny

- Vision: various, still in development

As I mentioned there at the end, vision is still in development. I have a working prototype in which images are taken every second, translated into text and then passed to my chat prompt. It works OK but is often wrong.

The project is open source under GPL-3, written with Python using PyQT6. You can find it here:

https://github.com/Capsize-Games/airunner

The compiled stable version is available for download on itch, but only includes image generation capabilities, everything else is in the unreleased 3.0.0 version

https://capsizegames.itch.io/ai-runner

I am the creator of AI Runner, an application that allows you to run Stable Diffusion and LLMs locally on your own hardware. It is built with pure python using PyQT6, Huggingface and many more libraries. The goal is to create a local AI Assistant that can run on local hardware.

Although the current compiled production version 2.2.0 is limited to Stable Diffusion, I have added LLM support and much more to the upcoming v3.0.0.

With it you can run chatbots, connect your camera and microphone to pull images and text for use with the chat bot (a work in progress) and much more.

I test heavily using a 2080s. Version 2.2.0 has also been tested with a 1080GTX and also runs on the CPU (albeit very slowly).

I'm using agents and tools for the bot as well, so you can make it do things like RAG, control the application, launch apps on your computer, generate prompts for stable diffusion and much more.

Additionally I have added text to speech (there are currently two options with various settings to choose from, SpeechT5 and Bark).

AI Runner is GPL 3.0 and uses pyinstaller to create a compiled version for Windows and Ubuntu, available here https://capsizegames.itch.io/ai-runner

Version 3.0.0 is still under development. I hope to launch within the next month or so, but if you'd like to get a pre-release preview you can install the latest version from master.

This is a passion project of mine that I've been working on since 2022. The upcoming version has been in development for around 7 months and during that time I got Covid and the flu which slowed me down by a little over a month.

If you have questions please don't hesitate to ask.

Hi, I am the creator of AI Runner - a GUI that allows you to run Stable Diffusion and Kandinsky locally from your own hardware without installing any additional libraries. It is a compiled open source application. Its currently 50% off during the itch.io summer sale (or free if you want to install the requirements from source - see link at the end of this post for more info)

I created a lowcost opensource no-install stable diffusion / kandinsky app called AI Runner that you might be interested in checking out https://capsizegames.itch.io/ai-runner

Bummer tho bud, sorry we couldn't get you up and running but good luck and don't give up yet lol, there are plenty of other UIs you can try out :D That reminds me, there's this one I tried a bit ago that someone on here released, it was easy to set up and would probably work for you.

AI Runner