Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Python video-processing Projects
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
vidgear
A High-performance cross-platform Video Processing Python framework powerpacked with unique trailblazing features :fire:
-
towhee
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
-
PySceneDetect
:movie_camera: Python and OpenCV-based scene cut/transition detection program & library.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
Real-time-GesRec
Real-time Hand Gesture Recognition with PyTorch on EgoGesture, NvGesture, Jester, Kinetics and UCF101
-
StoryToolkitAI
An editing tool that uses AI to transcribe, understand content and search for anything in your footage, integrated with ChatGPT and other AI models
-
-
-
movis
Python library for video editing, presentation video generation, motion graphics, shader art coding, and other video production tasks
-
Implicit-Internal-Video-Inpainting
[ICCV 2021]: IIVI: Internal Video Inpainting by Implicit Long-range Propagation
-
TecoGAN-PyTorch
A PyTorch Reimplementation of TecoGAN: Temporally Coherent GAN for Video Super-Resolution
-
deffcode
A cross-platform High-performance FFmpeg based Real-time Video Frames Decoder in Pure Python 🎞️⚡
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
You can always slice the images into smaller ones, run detection on each tile, and combine results. Supervision has a utility for this - https://supervision.roboflow.com/latest/detection/tools/infe..., but it only works with detections. You can get a much more accurate result this way. Here is some side-by-side comparison: https://github.com/roboflow/supervision/releases/tag/0.14.0.
Hey HN! We’re building Revideo (https://github.com/redotvideo/revideo), an open source toolkit that lets you programmatically create and export videos with the animation library Motion Canvas (https://github.com/motion-canvas/motion-canvas). This is useful whenever you want to build apps that automate certain video tasks, which is increasingly possible using AI tools - for instance, one of our first users is building an app that turns code documentation into video tutorials.
Revideo extends Motion Canvas with features that are essential for creating video, such as the ability to export audio tracks, a nodejs package for headless, parameterized & much faster rendering, and audio components that make audio editing and syncing easier. While Motion Canvas aims to be a standalone editor [1], we want to build a set of libraries that lets developers integrate video editing functionality into their apps. Our goal is to provide an open-source alternative to Remotion (https://github.com/remotion-dev/remotion).
At the start of this year, we explored a bunch of product ideas in the space of AI-based video creation. For example, we’ve built apps that automatically create educational short videos and have experimented with automatically A/B testing and personalizing video ads.
While building these products, we were frustrated with the video editing frameworks we used: Moviepy (https://github.com/Zulko/moviepy), which we relied on initially, doesn’t offer a way to preview your videos, so we’d often have to wait minutes for a video to render to test our code changes. Remotion (https://github.com/remotion-dev/remotion), which we switched to later, is really good, but we didn’t want to rely on it as it is not open source (source-available only). That’s why we decided to build Revideo.
We’d already been following Motion Canvas for some time and really liked using it, so we thought that extending it would get us to something useful much faster than building an animation library from scratch. Initially, we tried to build our features as Motion Canvas plugins, but this did not provide enough flexibility to achieve the desired functionality. Additionally, video-specific features (such as audio support) were generally considered out of scope by the Motion Canvas maintainers, which is why we ultimately ended up creating a fork. We’re unsure if this is the right way to go in the long term, and would prefer to find a way to build Revideo without diverging from Motion Canvas too much - if you have suggestions on how to solve this, we’d love your input.
Compared to Remotion, which builds on top of React, Motion Canvas uses the HTML Canvas API and makes you define animation flows with generator functions. Its API is more “procedural”, as it makes you define the things that happen in your animation as a sequence of yields, whereas Remotion gives you a frame number and lets you declare how your video should look like at that frame.
Our current focus is improving the open source project. In the long term, we want to make money by building a rendering service for developers building apps with Revideo. Such a service would offer a pretty similar deployment experience to Vercel, but instead of web apps, we let developers deploy Revideo projects and expose a rendering endpoint for them. Letting us manage the infrastructure will allow us to offer much faster rendering, as we can massively parallelize rendering jobs on our servers (e.g. spinning up 100 headless browsers that render 100 frames each to render a video with 10,000 frames).
We’d love to hear your feedback and suggestions! You can find our repo at https://github.com/redotvideo/revideo, We’ve also released an example video editing app at https://github.com/redotvideo/revideo-saas-template. Thank you!
[1] “Motion Canvas is not a normal npm package. It's a standalone tool that happens to be distributed via npm.” - https://github.com/orgs/motion-canvas/discussions/1015
My experience that played out over the last few weeks lead me to a similar belief, somewhat. For rather uninteresting reasons I decided I wanted to create mp4 videos of an animation programmatically, from scratch.
The first solution suggested when googling around is to just create all the frames, save them to disk, and then let ffmpeg do its thing from there. I would have just gone with that for a one-off task, but it seems like a pretty bad solution if the video is long, or high res, or both. Plus, what I really wanted was to build something more "scalable/flexible".
Maybe I didn't know the right keywords to search for, but there really didn't seem to be many options for creating frames, piping them straight to an encoder, and writing just the final video file to disk. The only one I found that seemed like it could maybe do it the way I had in mind was VidGear[1] (Python). I had figured that with the popularity of streaming, and video in general on the web, there would be so much more tooling for these sorts of things.
I ended up digging way deeper into this than I had intended, and built myself something on top of Membrane[2] (Elixir)
[1] https://abhitronix.github.io/vidgear/
Project mention: VidCutter: A program for lossless video cutting | news.ycombinator.com | 2023-08-20If you mean scene changes, this library works: https://github.com/Breakthrough/PySceneDetect
A few days ago I discovered a program that automatically trims the pauses from your video. This can decrease my raw footage duration by around 25%. I've used this for editing two videos so far, and this has been such a helpful tool.
I tried looking at using streamlit-webrtc, and I could not really convert the examples there to include communication with ROS over a topic.
There's StoryToolkitAI, it's free (But requires Davinci Resolve Studio). It can transcribe and generate subtitles quite accurately. It also has a feature to translate subtitles to English. I haven't tried the translate feature yet, but I've been using this tool for my work a lot. It also supports more languages than resolve's built in transcription and auto subtitle tool.
Project mention: Automatic video cut for podcast style recording - Like autopod | /r/kdenlive | 2023-05-04
Project mention: Show HN: GPT-Powered Video Retrieval and Streaming | news.ycombinator.com | 2024-02-08
Project mention: Show HN: Custom Action Recognition with ActionAI | news.ycombinator.com | 2023-09-23Hello HN!
We made an update to our most popular open source project ActionAI: https://github.com/smellslikeml/ActionAI
It's a toolkit to help anyone train and deploy custom action recognition models on the edge. More here: https://www.hackster.io/actionai/actionai-custom-tracking-mu...
We made a CLI so that it's even easier to install and deploy. This update uses Intel's dlstreamer with a gvapython element to run the classifier.
If you're interested in other kinds of model customizations, check out our efforts at https://remyx.ai.
Would love to hear your thoughts.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python video-processing related posts
- Show HN: Movis – A Video Editing Library in Python
- Deface: Video Anonymization by Face Detection
- Show HN: Custom Action Recognition with ActionAI
- Chat for video processing
- FFMPerative - Chat for video editing
- [WIP] Auto Edit Videos with LLMs
- Show HN: FFMPerative – Agent for video processing workflows
-
A note from our sponsor - InfluxDB
www.influxdata.com | 26 Apr 2024
Index
What are some of the best open-source video-processing projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | supervision | 13,984 |
| 2 | moviepy | 11,776 |
| 3 | vidgear | 3,190 |
| 4 | towhee | 2,989 |
| 5 | PySceneDetect | 2,774 |
| 6 | auto-editor | 2,481 |
| 7 | QualityScaler | 1,719 |
| 8 | streamlit-webrtc | 1,166 |
| 9 | caer | 749 |
| 10 | Real-time-GesRec | 590 |
| 11 | StoryToolkitAI | 573 |
| 12 | webcam-filters | 542 |
| 13 | deface | 540 |
| 14 | unsilence | 520 |
| 15 | WebmGenerator | 466 |
| 16 | StreamRAG | 392 |
| 17 | movis | 287 |
| 18 | Implicit-Internal-Video-Inpainting | 239 |
| 19 | TecoGAN-PyTorch | 207 |
| 20 | RealScaler | 206 |
| 21 | deffcode | 163 |
| 22 | FFMPerative | 146 |
| 23 | openheygen | 133 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com