Using Local LLMs for things besides chat?

• localGPT

  29 17,431 8.6 Python

  Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

  I tinker a lot with electronics. I have put datasheets for components, documentation for development boards, documentation for software libraries, etc into a database with localGPT.

• whisper.cpp

  160 25,852 9.5 C

  Port of OpenAI's Whisper model in C/C++

  That was already pretty good but the real killer is using it in combination with whisper.cpp for speech to text and bark for text to speech. Now I can just ask my computer for chip specification and stuff like that. It's held together with some questionable Python and shell code and I only used it for less than a week but I would probably go crazy if I had to go back to looking up things manually.

• Onboard AI

  getonboard.dev

  sponsored

  Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  

• bark

  60 28,486 7.5 Jupyter Notebook

  🔊 Text-Prompted Generative Audio Model

  

  That was already pretty good but the real killer is using it in combination with whisper.cpp for speech to text and bark for text to speech. Now I can just ask my computer for chip specification and stuff like that. It's held together with some questionable Python and shell code and I only used it for less than a week but I would probably go crazy if I had to go back to looking up things manually.

Suggest a related project