Our great sponsors
-
rust-bert
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Nope, but it's probably possible on a smaller, hobbyist scale. I've been playing with a few GPT libraries this week (namely rust-bert[0]) and I've been really impressive with local generation results on my crappy 2 core netbook. I can get 2 sentences to generate in ~5 seconds, which is pretty good in my book.
Armed with a Pi-style SBC and your AI library of choice, I bet you could get pretty far implementing some stuff. Bonus points if you use Whisper for speech-to-text, and double brownie points if you can get an AI voice to read the generation back.
[0] https://github.com/guillaume-be/rust-bert/tree/master/exampl...
chrome extenstion talk to chatGPT[1]
prophet, python talk to chatgpt [2]
call in to radio & get an on-the-air answer from chatgpt [3]
looks like text to image video of chatgpt answer might be more of a challenge.
[1] : https://github.com/C-Nedelcu/talk-to-chatgpt