video-processing

Top 23 video-processing Open-Source Projects

  • mediapipe

    Cross-platform, customizable ML solutions for live and streaming media.

  • Project mention: Mediapipe openpose Controlnet model for SD | /r/localdiffusion | 2023-11-15

    mediapipe/docs/solutions/pose.md at master · google/mediapipe · GitHub

  • Anime4K

    A High-Quality Real Time Upscaler for Anime Video

  • Project mention: AI Made These Movies Sharper. Critics Say It Ruined Them. | news.ycombinator.com | 2024-04-15

    I watch AI enhanced movies and/or shows every day when I use Anime4K, a real-time ML upscaler for anime https://github.com/bloc97/Anime4K

    If you give shit-tier blurry DVD messes, it turns them into nicer blurry messes.

    If you give it the usual bitrate starved streaming quality show, it looks almost as nice as a blueray.

    If you give it a blueray... It basically comes out looking exactly the same. I'll usually still add its "darken lines" filter since I'm a fan of strong linework.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • supervision

    We write your reusable computer vision tools. 💜

  • Project mention: Supervision: Reusable Computer Vision | news.ycombinator.com | 2024-03-24

    You can always slice the images into smaller ones, run detection on each tile, and combine results. Supervision has a utility for this - https://supervision.roboflow.com/latest/detection/tools/infe..., but it only works with detections. You can get a much more accurate result this way. Here is some side-by-side comparison: https://github.com/roboflow/supervision/releases/tag/0.14.0.

  • Waifu2x-Extension-GUI

    Video, Image and GIF upscale/enlarge(Super-Resolution) and Video frame interpolation. Achieved with Waifu2x, Real-ESRGAN, Real-CUGAN, RTX Video Super Resolution VSR, SRMD, RealSR, Anime4K, RIFE, IFRNet, CAIN, DAIN, and ACNet.

  • Project mention: Looking for ways to run AI GUI software via cloud gpu compute | /r/Cloud | 2023-11-13

    The software in question is on Github called Waifu2x-Extension-GUI https://github.com/AaronFeng753/Waifu2x-Extension-GUI

  • moviepy

    Video editing with Python

  • Project mention: Show HN: Revideo – Create Videos with Code | news.ycombinator.com | 2024-04-15

    Hey HN! We’re building Revideo (https://github.com/redotvideo/revideo), an open source toolkit that lets you programmatically create and export videos with the animation library Motion Canvas (https://github.com/motion-canvas/motion-canvas). This is useful whenever you want to build apps that automate certain video tasks, which is increasingly possible using AI tools - for instance, one of our first users is building an app that turns code documentation into video tutorials.

    Revideo extends Motion Canvas with features that are essential for creating video, such as the ability to export audio tracks, a nodejs package for headless, parameterized & much faster rendering, and audio components that make audio editing and syncing easier. While Motion Canvas aims to be a standalone editor [1], we want to build a set of libraries that lets developers integrate video editing functionality into their apps. Our goal is to provide an open-source alternative to Remotion (https://github.com/remotion-dev/remotion).

    At the start of this year, we explored a bunch of product ideas in the space of AI-based video creation. For example, we’ve built apps that automatically create educational short videos and have experimented with automatically A/B testing and personalizing video ads.

    While building these products, we were frustrated with the video editing frameworks we used: Moviepy (https://github.com/Zulko/moviepy), which we relied on initially, doesn’t offer a way to preview your videos, so we’d often have to wait minutes for a video to render to test our code changes. Remotion (https://github.com/remotion-dev/remotion), which we switched to later, is really good, but we didn’t want to rely on it as it is not open source (source-available only). That’s why we decided to build Revideo.

    We’d already been following Motion Canvas for some time and really liked using it, so we thought that extending it would get us to something useful much faster than building an animation library from scratch. Initially, we tried to build our features as Motion Canvas plugins, but this did not provide enough flexibility to achieve the desired functionality. Additionally, video-specific features (such as audio support) were generally considered out of scope by the Motion Canvas maintainers, which is why we ultimately ended up creating a fork. We’re unsure if this is the right way to go in the long term, and would prefer to find a way to build Revideo without diverging from Motion Canvas too much - if you have suggestions on how to solve this, we’d love your input.

    Compared to Remotion, which builds on top of React, Motion Canvas uses the HTML Canvas API and makes you define animation flows with generator functions. Its API is more “procedural”, as it makes you define the things that happen in your animation as a sequence of yields, whereas Remotion gives you a frame number and lets you declare how your video should look like at that frame.

    Our current focus is improving the open source project. In the long term, we want to make money by building a rendering service for developers building apps with Revideo. Such a service would offer a pretty similar deployment experience to Vercel, but instead of web apps, we let developers deploy Revideo projects and expose a rendering endpoint for them. Letting us manage the infrastructure will allow us to offer much faster rendering, as we can massively parallelize rendering jobs on our servers (e.g. spinning up 100 headless browsers that render 100 frames each to render a video with 10,000 frames).

    We’d love to hear your feedback and suggestions! You can find our repo at https://github.com/redotvideo/revideo, We’ve also released an example video editing app at https://github.com/redotvideo/revideo-saas-template. Thank you!

    [1] “Motion Canvas is not a normal npm package. It's a standalone tool that happens to be distributed via npm.” - https://github.com/orgs/motion-canvas/discussions/1015

  • ffmpeg-libav-tutorial

    FFmpeg libav tutorial - learn how media works from basic to transmuxing, transcoding and more. Translations: 🇺🇸 🇨🇳 🇰🇷 🇪🇸 🇻🇳 🇧🇷

  • gyroflow

    Video stabilization using gyroscope data

  • Project mention: Shot this using the Sony A7Cii handheld | /r/SonyAlpha | 2023-12-11

    I am no videographer and only read somewhere about gyro-stabilization and https://gyroflow.xyz So maybe that's an alternative to that software. Just leaving it here.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • vidgear

    A High-performance cross-platform Video Processing Python framework powerpacked with unique trailblazing features :fire:

  • Project mention: Why HTTP/3 is eating the world | news.ycombinator.com | 2023-10-05

    My experience that played out over the last few weeks lead me to a similar belief, somewhat. For rather uninteresting reasons I decided I wanted to create mp4 videos of an animation programmatically, from scratch.

    The first solution suggested when googling around is to just create all the frames, save them to disk, and then let ffmpeg do its thing from there. I would have just gone with that for a one-off task, but it seems like a pretty bad solution if the video is long, or high res, or both. Plus, what I really wanted was to build something more "scalable/flexible".

    Maybe I didn't know the right keywords to search for, but there really didn't seem to be many options for creating frames, piping them straight to an encoder, and writing just the final video file to disk. The only one I found that seemed like it could maybe do it the way I had in mind was VidGear[1] (Python). I had figured that with the popularity of streaming, and video in general on the web, there would be so much more tooling for these sorts of things.

    I ended up digging way deeper into this than I had intended, and built myself something on top of Membrane[2] (Elixir)

    [1] https://abhitronix.github.io/vidgear/

  • towhee

    Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

  • Project mention: FLaNK Stack Weekly for 14 Aug 2023 | dev.to | 2023-08-14
  • Rerender_A_Video

    [SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation

  • Project mention: List of Stable Diffusion research softwares that I don't think gotten widespread adoption. | /r/StableDiffusion | 2023-12-10

    https://github.com/williamyang1991/Rerender_A_Video -

  • PySceneDetect

    :movie_camera: Python and OpenCV-based scene cut/transition detection program & library.

  • Project mention: VidCutter: A program for lossless video cutting | news.ycombinator.com | 2023-08-20

    If you mean scene changes, this library works: https://github.com/Breakthrough/PySceneDetect

  • FFCreator

    一个基于node.js的高速视频制作库 A fast video processing library based on node.js

  • auto-editor

    Auto-Editor: Effort free video editing!

  • Project mention: How can I decrease my editing time? | /r/VideoEditing | 2023-05-22

    A few days ago I discovered a program that automatically trims the pauses from your video. This can decrease my raw footage duration by around 25%. I've used this for editing two videos so far, and this has been such a helpful tool.

  • staxrip

    🎞 Video encoding GUI for Windows.

  • Project mention: HandBrake 1.7.0 – The open source video transcoder | news.ycombinator.com | 2023-11-19

    Its literally a feature of all the underlying encoders. And you can do it even with exotic ffmpeg/vapoursynth filter chains. So I can't imagine why.

    TBH I would just recommend Staxrip if you are on Windows: https://github.com/staxrip/staxrip

    There is a linux equivalent, I can't remember what its called.

    Or maybe some av1an GUI for Mac/Linux. All of these things support a target file size with many more features.

  • MetalPetal

    A GPU accelerated image and video processing framework built on Metal.

  • Anime4KCPP

    A high performance anime upscaler

  • QualityScaler

    QualityScaler - image/video deeplearning upscaling for any GPU

  • Project mention: How do I change the learning hub video resolution? | /r/ANSYS | 2023-12-10
  • Cabbage

    A video composition framework build on top of AVFoundation. It's simple to use and easy to extend.

  • arcan

    Arcan - [Display Server, Multimedia Framework, Game Engine] -> "Desktop Engine"

  • Project mention: Is there a cross-platform graphics library that can run without X or wayland that runs on the BSD's bare-metal? | /r/BSD | 2023-12-08

    Something like this ? https://arcan-fe.com/

  • mlt

    MLT Multimedia Framework

  • Project mention: Kdenlive 24.02 open source video editor released | news.ycombinator.com | 2024-03-11

    I've used Kdenlive, Shotcut, Blender and Olive [1]. They all have strenghts and weaknesses, so I choose which one to use depending on what I'm trying to do, or sometimes I use two of them through a single video project.

    One thing to note is that Kdenlive and Shotcut both use the MLT video editing framework [2] under the hood, so their capabilities and constraints are very close to each other's. That said, their UIs are their own and some things may be easier to do in one over the other, may be a matter of personal preference. AFAIK Shotcut is developed by the same people who built MLT, but I don't think that gives it any particular advantage. Also both of these apps have the largest ready-made effects toolbox out of the four apps I mentioned at the top.

    Blender's VSE (video sequence editor) is great if you need fine-tuned 2D animations of elements because you can use all the same awesome keyframing tools you'd use for 3D animation, but it's severely lacking in other aspects, especially in the effects dept (you can crop, blur, mask, but not much else). For some reason you can't use Blender's compositor node system with video, which would enable many more capabilities if possible. There's also a steeper learning curve if you've never used Blender before because its UI breaks many conventions.

    Olive is a newcomer that doesn't get enough attention, but IMHO it was at one point the most promising OSS video editor out there. Sadly the developer works on it on his free time, and he's recently said that he's pausing development because he doesn't have the resources to work on it any more. I'm really hoping a miracle happens.

    There's two versions of Olive, 0.1 and 0.2 which is a complete rewrite. Both versions are good, but they work pretty differently. What got me excited about 0.2 is that its effects are node-based (unlike MLT-based editors which are stack-based), which enables far more advanced editing, although you probably wouldn't need that unless you're working on something quite ambitious.

    1: https://www.olivevideoeditor.org/

    2: https://www.mltframework.org/

  • libopenshot

    OpenShot Video Library (libopenshot) is a free, open-source project dedicated to delivering high quality video editing, animation, and playback solutions to the world. API currently supports C++, Python, and Ruby.

  • streamlit-webrtc

    Real-time video and audio streams over the network, with Streamlit.

  • Project mention: Streamlit dashboard with ROS2 | /r/ROS | 2023-08-18

    I tried looking at using streamlit-webrtc, and I could not really convert the examples there to include communication with ROS over a topic.

  • Mp4Composer-android

    This library generate an Mp4 movie using Android MediaCodec API and apply filter, scale, trim, transcode, crop, timeScale, mute and rotate Mp4.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

video-processing related posts

Index

What are some of the best open-source video-processing projects? This list will help you:

Project Stars
1 mediapipe 25,487
2 Anime4K 17,751
3 supervision 13,984
4 Waifu2x-Extension-GUI 12,039
5 moviepy 11,776
6 ffmpeg-libav-tutorial 9,600
7 gyroflow 6,086
8 vidgear 3,190
9 towhee 2,989
10 Rerender_A_Video 2,887
11 PySceneDetect 2,774
12 FFCreator 2,684
13 auto-editor 2,498
14 staxrip 2,001
15 MetalPetal 1,822
16 Anime4KCPP 1,746
17 QualityScaler 1,719
18 Cabbage 1,505
19 arcan 1,492
20 mlt 1,417
21 libopenshot 1,186
22 streamlit-webrtc 1,177
23 Mp4Composer-android 919

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com