Port of OpenAI's Whisper model in C/C++
whisper.cpp is really sick.
:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others
For self-hosting you can use https://github.com/go-skynet/LocalAI , uses whisper.cpp behind the scenes, and provides an OpenAI compatible API to interact with it.
Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.
1 project | news.ycombinator.com | 13 Nov 2023
Whisper C++ not working for me. Anyone else?
1 project | /r/Xcode | 11 Nov 2023
1 project | /r/hypeurls | 3 Nov 2023
Amazon Bedrock Is Now Generally Available
2 projects | news.ycombinator.com | 28 Sep 2023
Whisper ccp GGML Quantized?
1 project | /r/LocalLLaMA | 15 Aug 2023