aihandler VS inference

I mentioned this in an above comment - here is a repo that I use in two of my apps that I compiled with pyinstaller and distribute:

https://github.com/Capsize-Games/aihandler/blob/master/setup...

There are hundreds of not thousands of developers who have contributed to the libraries and dependencies of those libraries.

Are you saying that you feel it is up to someone (myself or some service) to track down and verify the identity of each of these developers, and that I shouldn't use these libraries or distribute them until that happens?

I have open sourced three of my projects that are somewhat related. You may find the compiled apps useful for your own creative projects, or perhaps you'd like to contribute to the codebase, or just use it to learn.

I have spoken about the apps on here in the past, but here's a break down:

AI Runner A no-install Stable Diffusion AI art application.

Github https://github.com/Capsize-Games/airunner

Itch https://capsizegames.itch.io/ai-runner

---

Chat AI: A no-install Google Flan-T5 interface and chatbot.

Github https://github.com/Capsize-Games/chatai

Itch https://capsizegames.itch.io/chat-ai

---

AI Handler The controller / engine that powers them both.

Github https://github.com/Capsize-Games/aihandler

This includes an offline client written for pyqt that works with signals (as well as one that doesn't) + a socket server & client. It also includes a queuing system etc.

It has the ability to switch between stable diffusion art generation and LLM text generation, handles memory management etc.

---

All of them:

* GPL-3.0

* Python

* Available on pypi

* Still need some work.

---

A note about the state of the code:

I switched from tkinter to pyqt recently.

Currently I'm only making use of the pyqt offline client. The socket server is probably slightly broken. I've created a Unity plugin that uses it, so I'll fix it and release that as well soon.

There may be caveats to installation of the code via pypi or otherwise. Compiled apps are in a working state, so if you choose to use from github, use it from the tagged releases, not master or develop branches.

Xorbits Inference (Xinference) is an open-source platform to streamline the operation and integration of a wide array of AI models. With Xinference, you’re empowered to run inference using any open-source LLMs, embedding models, and multimodal models either in the cloud or on your own premises, and create robust AI-driven applications. It provides a RESTful API compatible with OpenAI API, Python SDK, CLI, and WebUI. Furthermore, it integrates third-party developer tools like LangChain, LlamaIndex, and Dify, facilitating model integration and development.

Code: https://github.com/xorbitsai/inference/blob/main/examples/AI_podcast.py