FFMPerative VS vapoursynth

Hello HN!

We made an update to our most popular open source project ActionAI: https://github.com/smellslikeml/ActionAI

It's a toolkit to help anyone train and deploy custom action recognition models on the edge. More here: https://www.hackster.io/actionai/actionai-custom-tracking-mu...

We made a CLI so that it's even easier to install and deploy. This update uses Intel's dlstreamer with a gvapython element to run the classifier.

If you're interested in other kinds of model customizations, check out our efforts at https://remyx.ai.

Would love to hear your thoughts.

In the spirit of making FFmpeg and video processing easier, we open-sourced a chat-based agent to assist video production - https://github.com/remyxai/FFMPerative

If you're looking for a quick way to edit/process video, we open sourced FFMPerative, a chat tool for video editing. It's easy to install and use and if you're running Ubuntu, you can install with apt-get install ffmperative

We open-sourced a command line tool for easy video editing. FFMPerative allows you to compose video edits in natural language. Simply describe your edits and it will handle the rest.

We use GPT-4/Vicuna as a video director, planning a sequence of video edits when provided with the necessary context about the video clips. Video-LLaMA and Whisper allow us to extract more context through video understanding and transcripts. With FFMPerative, we execute the described edit plan and put together a video.

Repo: https://github.com/remyxai/FFMPerative

Since ffmpeg CLI still makes me pull ny hair out, I am going to plug vapoursynth:

https://www.vapoursynth.com/

Its Pythonic video filters... But also so much more: https://vsdb.top/

And Staxrip, which makes such good use of ffmpeg, vapoursynth, and dozens of other encoders and tools that I reboot from linux to Windows just to use it: https://github.com/staxrip/staxrip

git clone https://github.com/vapoursynth/vapoursynth cd vapoursynth ./configure make sudo make install

Are you aware of Vapoursynth? https://www.vapoursynth.com/

I have a few options here to process the individual frames for example using ImageData, which exposes the data as an array of pixels, so you could easily 'borrow' some VapourSynth filters for this:

Does the name AviSynth mean anything to you? If so and you want a similar Linux native tool "inspired" by AviSynth, to quote the website, check out http://www.vapoursynth.com/ Just bear in mind that the scripting language is different.

I'm a total newbie to CUDA. I'm trying to implement NVOF in VapourSynth video processing framework. I got the NVOF context initialized. Next step is the buffers!

Download vapoursynth r57 portable from https://github.com/vapoursynth/vapoursynth/releases it's a 7z file so you should have 7-zip installed

Download and compile vapoursynth 1) Go to vapoursynth’s gihub (https://github.com/vapoursynth/vapoursynth/releases) download/wget the tar.gz 2) extract it with tar -xf 3) cd into the folder 4) sudo ./autogen.sh 5) sudo ./configure 6) sudo make install