What are you doing about self-hosted AI Models?

• whisper.cpp

  187 31,817 9.8 C

  Port of OpenAI's Whisper model in C/C++

First, I cloned whisper.cpp and built it with cuBLAS enabled (you might need different options depending on what hardware you are using).

• go-subgen

  3 53 7.1 Go

  Automatically generate subtitles for your media using whisper.cpp via webhooks with support for Radarr & Sonarr

Have you looked at https://github.com/khakers/go-subgen to maybe automate a lot of that?

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• text-generation-webui

  876 37,023 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

You could try running one of the vicuna variants with oobagooba. I played a bit with the 13 billion parameter version on my 3060 and it was fine. I think there are more impressive models now but you should be able to run a larger model on your card.

• automatic

  185 4,793 9.9 Python

  SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models

Suggest a related project