Sam 2: Segment Anything in Images and Videos

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  1. sam2

    The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

    Yes I did give it a glance, polite and clever HN member, it showed an object in a sequence of images extracted from video, and evidently followed the object from sequence.

    Perhaps however my interpretation of what happens here is way off, which is why I asked in an obviously incorrect and stupid way that you have pointed out to me without clarifying exactly why it was incorrect and stupid.

    So anyway there is the extraction of the object I referred to, but also seeming to follow the object through sequence of scenes?

    https://github.com/facebookresearch/segment-anything-2/raw/m...

    So it seems to me that they identify the object and follow it for a contiguous sequence. Img1, img2, img3, img4, is my interpretation incorrect here?

    But what I am wondering is - what happens if the object is not in img3 - like perhaps two people talking and shifting viewpoint from person talking to person listening. Person talking is in img1, img2, img4. Can you get that sequence or is it just img1, img2 the sequence.

    It says "We extend SAM to video by considering images as a video with a single frame." which I don't know what that means, does it mean that they concatenated all the video frames into a single image and identified the object in them, in which case their example still shows contiguous images without the object ever disappearing so my question still pertains.

    So anyway my conclusion is what said when addressing me was wrong, to quote: "what SAM does is immediately apparent when you view the home page" because I (the you addressed) viewed the homepage I wondered about some things? Obviously wrong things that you have identified as being wrong.

    And thus my question is: If what same does immediately apparent when you view the home page maybe you can point out where my understanding has failed.

  2. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  3. autodistill

    Images to inference with no labeling (use foundation models to train supervised models).

  4. replicate-javascript

    Node.js client for Replicate

    Previous SAM v1 you can use e.g. in here:

    https://fal.ai/models

    https://replicate.com/

    You just have to wait probably few weeks for the SAM v2 to be available. Hugging Face might also have some offering

  5. co-tracker

    CoTracker is a model for tracking any point (pixel) on a video.

    Of course Facebook has had a video tracking ML model for a year or so - Co-tracker [1] - just tracking pixels rather than segments.

    [1] https://co-tracker.github.io/

  6. mullvadvpn-app

    The Mullvad VPN client app for desktop and mobile

    Which German regulation prevents this?

    Also, it seems that https://mullvad.net is a necessary part of my Internet toolkit these days for many reasons.

  7. gimpsegany

    Gimp plugin for integration with Meta Segment Anything

  8. gimp-segment-anything

    a wrapper for meta segment anything for gimp

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • IRC Driven – modern IRC indexing site and search engine

    7 projects | news.ycombinator.com | 13 Jan 2025
  • Simonw's notes on Cloudflare's new SQLite-backed "Durable Objects" system

    3 projects | news.ycombinator.com | 13 Oct 2024
  • Transitioning From PyTorch to Burn

    5 projects | dev.to | 14 Feb 2024
  • Nvidia Is Now More Valuable Than Amazon and Google

    3 projects | news.ycombinator.com | 12 Feb 2024
  • A New Chapter for Mozilla

    2 projects | news.ycombinator.com | 8 Feb 2024

Did you know that Python is
the 2nd most popular programming language
based on number of references?