Top 11 video-object-segmentation Open-Source Projects

• Track-Anything

  16 6,104 8.1 Python

  Track-Anything is a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything, XMem, and E2FGVI.

Project mention: Keying/masking person on a footage | /r/davinciresolve | 2023-10-21

I was doing rotoscoping for a silhouette of a girl dancing in front of a building, then I saw this amazing tool: https://github.com/gaomingqi/Track-Anything

• Segment-and-Track-Anything

  2 2,451 6.3 Jupyter Notebook

  An open-source project dedicated to tracking and segmenting any objects in videos, either automatically or interactively. The primary algorithms utilized include the Segment Anything Model (SAM) for key-frame segmentation and Associating Objects with Transformers (AOT) for efficient tracking and propagation purposes.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• XMem

  11 1,594 6.3 Python

  [ECCV 2022] XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model

Project mention: [D] Which open source models can replicate wonder dynamics's drag'n'drop cg characters? | /r/MachineLearning | 2023-06-11

Use Segmentation Model (SAM) combined with Inpainting model (E2FGVI) and Xmem to cut out the live action subject.

• UNINEXT

  2 1,443 5.5 Python

  [CVPR'23] Universal Instance Perception as Object Discovery and Retrieval

• Unicorn

  7 942 0.0 Python

  [ECCV'22 Oral] Towards Grand Unification of Object Tracking (by MasterBin-IIAU)

• sam-pt

  1 905 5.7 Python

  SAM-PT: Extending SAM to zero-shot video segmentation with point-based tracking.

  

Project mention: using AI to fill the scenes vertically | /r/StableDiffusion | 2023-07-12

Part of this process can be a remastering step also for old videos. Masking backgrounds across frames and performing super-resolution with all known references and scaling details for characters using fine-tuned models for each actor. We have a lot new SAM tools to assist with this process. It probably won't be magically done for a while, but a few people could remaster a show rather than a large team.

• GLEE

  1 897 5.6 Python

  [CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale (by FoundationVision)

  

Project mention: FLaNK AI - 01 April 2024 | dev.to | 2024-04-01

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• MiVOS

  2 448 4.6 Python

  [CVPR 2021] Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion. Semi-supervised VOS as well!

• UniTrack

  1 335 1.8 Python

  [NeurIPS'21] Unified tracking framework with a single appearance model. It supports Single Object Tracking (SOT), Video Object Segmentation (VOS), Multi-Object Tracking (MOT), Multi-Object Tracking and Segmentation (MOTS), Pose Tracking, Video Instance Segmentation (VIS), and class-agnostic MOT (e.g. TAO dataset). (by Zhongdao)

• MOSE-api

  1 290 4.5 Python

  [ICCV 2023] MOSE: A New Dataset for Video Object Segmentation in Complex Scenes

• tcow

  1 36 3.9 Python

  Tracking through Containers and Occluders in the Wild (CVPR 2023) - Official Implementation

Project mention: Tracking through Containers and Occluders in the Wild- Meet TCOW: An AI Model that can Segment Objects in Videos with a Notion of Object Permanence | /r/machinelearningnews | 2023-05-09

Github: https://github.com/basilevh/tcow

video-object-segmentation related posts

• Keying/masking person on a footage

  1 project | /r/davinciresolve | 21 Oct 2023

• Advice for multi-animal tracking for scientific research?

  1 project | /r/computervision | 14 Jun 2023

• [D] Which open source models can replicate wonder dynamics's drag'n'drop cg characters?

  6 projects | /r/MachineLearning | 11 Jun 2023

• Tutorial for Track-Anything, an interactive tool to segment, track, and inpaint anything in videos.

  1 project | /r/StableDiffusion | 10 May 2023

• Tutorial for Track-Anything, an interactive tool to segment, track, and inpaint anything in videos.

  1 project | /r/TrackAnything | 10 May 2023

• Github for Track Anything

  1 project | /r/TrackAnything | 10 May 2023

• Segment Anything for Video - Track Anything! 🤖

  1 project | /r/callabacloud | 2 May 2023
• A note from our sponsor - SaaSHub
  www.saashub.com | 2 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com