modal-examples VS yt-whisper

We made a small app for SDXL Lightning, running your own Python code on GPUs. It generates images in real time.

https://potatoes.ai/

We know there was a fal.ai post yesterday, and that got a lot of interest, but we also made this demo yesterday and didn't share — just wanted to mention it as an alternative option for people who like running their own code and custom models instead of using a prebuilt API provider.

The backend code is open-source too and you can deploy it yourself: https://github.com/modal-labs/modal-examples/blob/main/06_gpu_and_ml/stable_diffusion/stable_diffusion_xl_lightning.py

The startup I work at is relatively pretty good at documentation engineering. We have written code to test the code snippets in docstrings (https://github.com/modal-labs/pytest-markdown-docs) and we have written code to do synthetic monitoring testing of the examples in our examples repo (https://github.com/modal-labs/modal-examples). We are also diligent about putting using Python's warnings library to handle API deprecation, and treat deprecation warnings as errors internally, ensuring our own code samples and examples are most up-to-date.

You can get it running with one Python script on Modal.com :)

https://github.com/modal-labs/modal-examples/blob/main/06_gp...

This demo lets you choose the podcast, and is open-source: https://modal-labs--whisper-pod-transcriber-fastapi-app.moda...

https://github.com/modal-labs/modal-examples/tree/main/06_gp...

Transcribes 1hr of audio in roughly 1min, using parallelisation across CPUs.

This demo is open-source: https://github.com/modal-labs/modal-examples/tree/main/06_gp....

https://modal-labs--whisper-pod-transcriber-fastapi-app.moda...

It's become so easy to stick together ML models, often without training most or all of them yourself.

*video demo:* https://youtu.be/mQsMuM8d4Qc

*cloud platform:* https://modal.com

*code*: https://github.com/modal-labs/modal-examples/tree/main/06_gp...

Transcription - OpenAI just released Whisper. Check out what it can do with podcasts

Here's the source code.

#28 transcribe local files

Or even better, yt-whisper, which uses OpenAI's Whisper speech to text. I guess it'd be better to first check whether the video has captions first before Whispering, so maybe both your command and this one could be used together.

https://github.com/m1guelpf/yt-whisper

With minimal changes to https://github.com/m1guelpf/yt-whisper i got a setup to transcribe subs from YouTube videos or local files bit it might take an hour or so running the large model on my CPU.