Python video-processing

Open-source Python projects categorized as video-processing

Top 23 Python video-processing Projects

video-processing
  • supervision

    We write your reusable computer vision tools. 💜

    Project mention: Show HN: I am using AI to drop hats outside my window onto New Yorkers | news.ycombinator.com | 2024-06-23

    FWIW you can use roboflow models on-device as well. detect.roboflow.com is just a hosted version of our inference server (if you run the docker somewhere you can swap out that URL for localhost or wherever your self-hosted one is running). Behind the scenes it’s an http interface for our inference[1] Python package which you can run natively if your app is in Python as well.

    Pi inference is pretty slow (probably ~1 fps without an accelerator). Usually folks are using CUDA acceleration with a Jetson for these types of projects if they want to run faster locally.

    Some benefits are that there are over 100k pre-trained models others have already published to Roboflow Universe[2] you can start from, supports many of the latest SOTA models (with an extensive library[3] of custom training notebooks), and tight integration with the dataset/annotation tools that are at the core of Roboflow for creating custom models, and good support for common downstream tasks via supervision[4].

    [1] https://github.com/roboflow/inference

    [2] https://universe.roboflow.com

    [3] https://github.com/roboflow/notebooks

    [4] https://github.com/roboflow/supervision

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • moviepy

    Video editing with Python

    Project mention: Show HN: Revideo – Create Videos with Code | news.ycombinator.com | 2024-04-15

    Hey HN! We’re building Revideo (https://github.com/redotvideo/revideo), an open source toolkit that lets you programmatically create and export videos with the animation library Motion Canvas (https://github.com/motion-canvas/motion-canvas). This is useful whenever you want to build apps that automate certain video tasks, which is increasingly possible using AI tools - for instance, one of our first users is building an app that turns code documentation into video tutorials.

    Revideo extends Motion Canvas with features that are essential for creating video, such as the ability to export audio tracks, a nodejs package for headless, parameterized & much faster rendering, and audio components that make audio editing and syncing easier. While Motion Canvas aims to be a standalone editor [1], we want to build a set of libraries that lets developers integrate video editing functionality into their apps. Our goal is to provide an open-source alternative to Remotion (https://github.com/remotion-dev/remotion).

    At the start of this year, we explored a bunch of product ideas in the space of AI-based video creation. For example, we’ve built apps that automatically create educational short videos and have experimented with automatically A/B testing and personalizing video ads.

    While building these products, we were frustrated with the video editing frameworks we used: Moviepy (https://github.com/Zulko/moviepy), which we relied on initially, doesn’t offer a way to preview your videos, so we’d often have to wait minutes for a video to render to test our code changes. Remotion (https://github.com/remotion-dev/remotion), which we switched to later, is really good, but we didn’t want to rely on it as it is not open source (source-available only). That’s why we decided to build Revideo.

    We’d already been following Motion Canvas for some time and really liked using it, so we thought that extending it would get us to something useful much faster than building an animation library from scratch. Initially, we tried to build our features as Motion Canvas plugins, but this did not provide enough flexibility to achieve the desired functionality. Additionally, video-specific features (such as audio support) were generally considered out of scope by the Motion Canvas maintainers, which is why we ultimately ended up creating a fork. We’re unsure if this is the right way to go in the long term, and would prefer to find a way to build Revideo without diverging from Motion Canvas too much - if you have suggestions on how to solve this, we’d love your input.

    Compared to Remotion, which builds on top of React, Motion Canvas uses the HTML Canvas API and makes you define animation flows with generator functions. Its API is more “procedural”, as it makes you define the things that happen in your animation as a sequence of yields, whereas Remotion gives you a frame number and lets you declare how your video should look like at that frame.

    Our current focus is improving the open source project. In the long term, we want to make money by building a rendering service for developers building apps with Revideo. Such a service would offer a pretty similar deployment experience to Vercel, but instead of web apps, we let developers deploy Revideo projects and expose a rendering endpoint for them. Letting us manage the infrastructure will allow us to offer much faster rendering, as we can massively parallelize rendering jobs on our servers (e.g. spinning up 100 headless browsers that render 100 frames each to render a video with 10,000 frames).

    We’d love to hear your feedback and suggestions! You can find our repo at https://github.com/redotvideo/revideo, We’ve also released an example video editing app at https://github.com/redotvideo/revideo-saas-template. Thank you!

    [1] “Motion Canvas is not a normal npm package. It's a standalone tool that happens to be distributed via npm.” - https://github.com/orgs/motion-canvas/discussions/1015

  • vidgear

    A High-performance cross-platform Video Processing Python framework powerpacked with unique trailblazing features :fire:

    Project mention: Why HTTP/3 is eating the world | news.ycombinator.com | 2023-10-05

    My experience that played out over the last few weeks lead me to a similar belief, somewhat. For rather uninteresting reasons I decided I wanted to create mp4 videos of an animation programmatically, from scratch.

    The first solution suggested when googling around is to just create all the frames, save them to disk, and then let ffmpeg do its thing from there. I would have just gone with that for a one-off task, but it seems like a pretty bad solution if the video is long, or high res, or both. Plus, what I really wanted was to build something more "scalable/flexible".

    Maybe I didn't know the right keywords to search for, but there really didn't seem to be many options for creating frames, piping them straight to an encoder, and writing just the final video file to disk. The only one I found that seemed like it could maybe do it the way I had in mind was VidGear[1] (Python). I had figured that with the popularity of streaming, and video in general on the web, there would be so much more tooling for these sorts of things.

    I ended up digging way deeper into this than I had intended, and built myself something on top of Membrane[2] (Elixir)

    [1] https://abhitronix.github.io/vidgear/

  • towhee

    Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

    Project mention: FLaNK Stack Weekly for 14 Aug 2023 | dev.to | 2023-08-14
  • PySceneDetect

    :movie_camera: Python and OpenCV-based scene cut/transition detection program & library.

    Project mention: VidCutter: A program for lossless video cutting | news.ycombinator.com | 2023-08-20

    If you mean scene changes, this library works: https://github.com/Breakthrough/PySceneDetect

  • auto-editor

    Auto-Editor: Efficient media analyze and rendering

  • QualityScaler

    QualityScaler - image/video deeplearning upscaling for any GPU

    Project mention: How do I change the learning hub video resolution? | /r/ANSYS | 2023-12-10
  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • streamlit-webrtc

    Real-time video and audio streams over the network, with Streamlit.

    Project mention: Streamlit dashboard with ROS2 | /r/ROS | 2023-08-18

    I tried looking at using streamlit-webrtc, and I could not really convert the examples there to include communication with ROS over a topic.

  • caer

    High-performance Vision library in Python. Scale your research, not boilerplate.

  • StoryToolkitAI

    An editing tool that uses AI to transcribe, understand content and search for anything in your footage, integrated with ChatGPT and other AI models

    Project mention: Creating a workflow with translated subtitles | /r/davinciresolve | 2023-08-17

    There's StoryToolkitAI, it's free (But requires Davinci Resolve Studio). It can transcribe and generate subtitles quite accurately. It also has a feature to translate subtitles to English. I haven't tried the translate feature yet, but I've been using this tool for my work a lot. It also supports more languages than resolve's built in transcription and auto subtitle tool.

  • Real-time-GesRec

    Real-time Hand Gesture Recognition with PyTorch on EgoGesture, NvGesture, Jester, Kinetics and UCF101

  • deface

    Video anonymization by face detection

    Project mention: Deface: Video Anonymization by Face Detection | news.ycombinator.com | 2023-10-24
  • webcam-filters

    Add filters (background blur, etc) to your webcam on Linux.

  • unsilence

    Console Interface and Library to remove silent parts of a media file 🔈

  • WebmGenerator

    UI and Automation to cut, filter and join high quality webms, mp4s or gifs.

  • StreamRAG

    Video Search and Streaming Agent 🕵️‍♂️

    Project mention: Show HN: GPT-Powered Video Retrieval and Streaming | news.ycombinator.com | 2024-02-08
  • movis

    Python library for video editing, presentation video generation, motion graphics, shader art coding, and other video production tasks

    Project mention: FLaNK Stack Weekly for 20 Nov 2023 | dev.to | 2023-11-20
  • Implicit-Internal-Video-Inpainting

    [ICCV 2021]: IIVI: Internal Video Inpainting by Implicit Long-range Propagation

  • RealScaler

    RealScaler - image/video AI upscaler app (Real-ESRGAN)

  • TecoGAN-PyTorch

    A PyTorch Reimplementation of TecoGAN: Temporally Coherent GAN for Video Super-Resolution

  • deffcode

    A cross-platform High-performance FFmpeg based Real-time Video Frames Decoder in Pure Python 🎞️⚡

  • FFMPerative

    Chat to Compose Video

    Project mention: Show HN: Custom Action Recognition with ActionAI | news.ycombinator.com | 2023-09-23

    Hello HN!

    We made an update to our most popular open source project ActionAI: https://github.com/smellslikeml/ActionAI

    It's a toolkit to help anyone train and deploy custom action recognition models on the edge. More here: https://www.hackster.io/actionai/actionai-custom-tracking-mu...

    We made a CLI so that it's even easier to install and deploy. This update uses Intel's dlstreamer with a gvapython element to run the classifier.

    If you're interested in other kinds of model customizations, check out our efforts at https://remyx.ai.

    Would love to hear your thoughts.

  • openheygen

    HeyGen's open source solution

    Project mention: HeyGen's Open Source Solution | news.ycombinator.com | 2023-11-10
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python video-processing discussion

Log in or Post with

Python video-processing related posts

  • Show HN: Movis – A Video Editing Library in Python

    2 projects | news.ycombinator.com | 15 Nov 2023
  • Deface: Video Anonymization by Face Detection

    1 project | news.ycombinator.com | 24 Oct 2023
  • Show HN: Custom Action Recognition with ActionAI

    2 projects | news.ycombinator.com | 23 Sep 2023
  • Chat for video processing

    1 project | /r/youtubedl | 7 Jul 2023
  • FFMPerative - Chat for video editing

    1 project | /r/commandline | 7 Jul 2023
  • [WIP] Auto Edit Videos with LLMs

    1 project | /r/LocalLLaMA | 24 Jun 2023
  • Show HN: FFMPerative – Agent for video processing workflows

    1 project | news.ycombinator.com | 31 May 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 25 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source video-processing projects in Python? This list will help you:

Project Stars
1 supervision 16,827
2 moviepy 12,024
3 vidgear 3,259
4 towhee 3,051
5 PySceneDetect 2,934
6 auto-editor 2,616
7 QualityScaler 1,818
8 streamlit-webrtc 1,243
9 caer 751
10 StoryToolkitAI 619
11 Real-time-GesRec 613
12 deface 572
13 webcam-filters 545
14 unsilence 538
15 WebmGenerator 476
16 StreamRAG 410
17 movis 314
18 Implicit-Internal-Video-Inpainting 243
19 RealScaler 232
20 TecoGAN-PyTorch 207
21 deffcode 166
22 FFMPerative 159
23 openheygen 150

Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com

Did you konow that Python is
the 1st most popular programming language
based on number of metions?