This is getting really complicated.

1. koboldcpp

   1 184 7,793 10.0 C++

   Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

   

   It's just possible you're using the wrong project. There are projects initially aimed at use and not at study. For example https://github.com/LostRuins/koboldcpp/releases/tag/v1.30.3

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. easydiffusion

   2 16 10,020 8.5 JavaScript

   An easy 1-click way to create beautiful artwork on your PC using AI, with no tech knowledge. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image.

   

4. agency

   3 3 433 7.4 Python

   A fast and minimal framework for building agentic systems

   

5. SillyTavern

   4 77 16,081 10.0 JavaScript

   LLM Frontend for Power Users.

   

   there is not really a rule on this part, it's just that generally on cpu for each core you have double the threads (eg : 8cores / 16 threads) and with this info I like to have the max number of threads -2 becaus I heard somewhere that if you used all of your threads you PC can freeze while generating ( I haven't tested this claim). also about the streaming part if you use ST (silly tavern) I heard that on their github on the dev branch they added support for SSE streaming (the new way of streaming token to a UI on the web), which without entering technicality it is better than before.

6. tortoise-tts

   5 148 14,414 6.5 Jupyter Notebook

   A multi-voice TTS system trained with an emphasis on quality

   

   https://github.com/neonbjb/tortoise-tts looks and sounds pretty awesome.

7. audio-webui

   6 15 1,187 3.0 Python

   A webui for different audio related Neural Networks

   

   I've been playing with this: https://github.com/gitmylo/audio-webui

8. LLamaSharp

   7 7 3,277 9.6 C#

   A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

   

   For example, I have my own task and I need another tool, so I search and find what I need. https://github.com/SciSharp/LLamaSharp and this allows me to take the next step https://github.com/Xsanf/LLaMa_Unity . I can already run LLM on Unity. And this is already an opportunity to use it in games natively.

9. Stream

   getstream.io featured

   Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

   

10. LLaMa_Unity

    8 1 5 5.6

    

    For example, I have my own task and I need another tool, so I search and find what I need. https://github.com/SciSharp/LLamaSharp and this allows me to take the next step https://github.com/Xsanf/LLaMa_Unity . I can already run LLM on Unity. And this is already an opportunity to use it in games natively.

Suggest a related project