pydub VS mingus

Honestly while, C++ is used for professional audio software, you can get a lot done with python and a library like pydub, or you can even learn to manipulate audio files without any libraries in any language. So if you are not particulary interested in C++ at the moment you can start with Python, which is easier to learn. You can check out other python audio manipulation libraries here

I doubt it will matter if you're breaking up mid sentence if you pass in the previous as a prompt and split words. This is how Whisper does it internally.

It's not absolutely perfect, but splitting on the word boundary is one line of code with the same package in their docs: https://github.com/jiaaro/pydub/blob/master/API.markdown#sil...

25MB is also a lot. That's 30 minutes to an hour on MP3 at reasonable compression. A 2 hour movie would have three splits.

Even given an option it can be difficult to find the corresponding documentation, if only because of the many different submodules and encoders and decoders and filters that have o-so-slightly different options. That said, I've just switched from pydub to ffmpeg-python (due to memory issues of the former[1]) and judging from the Jupiter notebook[2] it seems a much more intuitive method of constructing ffmpeg pipelines.

[1] https://github.com/jiaaro/pydub/issues/135

[2] https://github.com/kkroening/ffmpeg-python/tree/master/examp...

With the file downloaded, we're now going to arbitrarily slice it locally (you might have considered wheter it is possible to simply download a clip from youtube; all reliable methods I've found will essentially boil down to downloading the whole and then editing locally). For that we'll use the pydub library:

I guess it's possible in theory, a quick search suggest pydub library.​But you may find something better if you do a little research.

Uses https://github.com/cheofusi/just_playback to play sound. It's actually surprising how hard it was to find a cross-platform Python module to play sound that doesn't require an external dependency like ffmpeg. Even then, modules like https://github.com/jiaaro/pydub don't support features like seeking/scrubbing, which was a must-have for my project.

Once python is installed, you will also need to install the "pydub" package for this script to work. If you're on a Windows computer, you can do this from the command line (run the "cmd") program. If you're on mac, you can do this from the terminal. Basically, the way that you do this is using "pip" -- a "helper" program that comes with python. Once you launch the command line, just run the command python -m pip install pydub --upgrade and you should see a message showing that it successfully installed. If you're struggling with this step, just google how to "pip install python packages" and you can find a lot of beginner guides.

That is kinda what serverless functions are built for. Looks like python has some good libraries for this: https://github.com/jiaaro/pydub.

The files are big, so it's not feasible to load one in all at once. They have to be streamed/chunked somehow. (sadly, pydub doesn't support this...)

We need to download a few files, including keys.png, which is the image of the piano GUI. The other file we need is the Yamaha-Grand-ios-v1.2 from this site. A SoundFont contains a sample of musical instruments; in our case, we’ll need a piano sound.