Using Local LLMs for things besides chat?

• localGPT

  29 19,193 8.6 Python

  Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

I tinker a lot with electronics. I have put datasheets for components, documentation for development boards, documentation for software libraries, etc into a database with localGPT.

• whisper.cpp

  187 31,426 9.8 C

  Port of OpenAI's Whisper model in C/C++

That was already pretty good but the real killer is using it in combination with whisper.cpp for speech to text and bark for text to speech. Now I can just ask my computer for chip specification and stuff like that. It's held together with some questionable Python and shell code and I only used it for less than a week but I would probably go crazy if I had to go back to looking up things manually.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• bark

  67 32,668 5.4 Jupyter Notebook

  🔊 Text-Prompted Generative Audio Model

  

That was already pretty good but the real killer is using it in combination with whisper.cpp for speech to text and bark for text to speech. Now I can just ask my computer for chip specification and stuff like that. It's held together with some questionable Python and shell code and I only used it for less than a week but I would probably go crazy if I had to go back to looking up things manually.

Suggest a related project