Track-Anything
TaskMatrix
Track-Anything | TaskMatrix | |
---|---|---|
16 | 10 | |
6,113 | 34,527 | |
- | 0.1% | |
8.1 | 7.3 | |
3 months ago | 4 months ago | |
Python | Python | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Track-Anything
-
Keying/masking person on a footage
I was doing rotoscoping for a silhouette of a girl dancing in front of a building, then I saw this amazing tool: https://github.com/gaomingqi/Track-Anything
-
Advice for multi-animal tracking for scientific research?
My question is, how can we modernize this pipeline? We've experimented a bit with the new SAM-based track-anything tool, and it seems promising, but we actually don't want to "track anything", we only want to track fishes. What would you do in 2023, to extract tracks of one specific class of object from long video datasets? I'm hoping for any advice at all.
-
[D] Which open source models can replicate wonder dynamics's drag'n'drop cg characters?
The Track-Anything tool already implements this
- Tutorial for Track-Anything, an interactive tool to segment, track, and inpaint anything in videos.
- Github for Track Anything
-
Segment Anything for Video - Track Anything! 🤖
Segment Anything for Video - Track Anything! 🤖 With this tool, you can automatically isolate objects, make edits using inpainting, and track objects with precision. It's a game-changer for creative projects. Even though it does not work well with the shadows yet, we expect a rapid evolution of these technologies. Github : https://github.com/gaomingqi/Track-Anything)
-
How to adapt an existing Python project to my specific use case without bringing in unnecessary dependencies or reinventing the wheel
I would like to know if there are any guidelines to follow when adapting an existing Python project for my own use-case. Specifically, I want to customize the output of the Track-Anything project by incorporating my own processing steps. However, I do not want to import the entire codebase. Rather, I only want to import the minimum amount of code necessary to produce the same output with object tracking, without having to reimplement functions that are already available.
- Track-Anything should get implemented in kdelive
-
SUSTech VIP Lab Proposes Track Anything Model (TAM) That Achieves High-Performance Interactive Tracking and Segmentation in Videos
Here is the GitHub: https://github.com/gaomingqi/track-anything
TaskMatrix
-
How to create an automation workflow with GPT-4 image input?
I want to create a script that would automatically read telegram posts and process them, for this, using APIs these days is simply not reliable, so I'm thinking of using selenium python with the browser to do this..is there a way to develop an automated workflow that does this? I've looked in visual GPT from Microsoft https://github.com/microsoft/TaskMatrix
- TaskMatrix
- TaskMatrix Connects ChatGPT and a Series of Visual Foundation Models
-
April 2023
Low-code LLM (https://github.com/microsoft/TaskMatrix/tree/main/LowCodeLLM)
-
GPT-4 with browsing prompt
Yep, this is what Microsoft and others have done with the API to create things like bing chat. See: https://github.com/microsoft/TaskMatrix
-
[D] LLM or model that does image -> prompt?
Visual ChatGPT (now renamed as TaskMatrix https://github.com/microsoft/TaskMatrix likely as a result of OpenAI trying to regulate the use of the name GPT. Same happened for GPT-Eval -> G-Eval).
-
What’s stopping ChatGPT from replacing a bunch of jobs right now?
Microsoft is also going to connect millions of APIs. Right now software for the most part lives in silos and needs humans to move information from one software application to another. TaskMatrixAI will automate that by having a standard API schema that everyone buys into like Apple’s iOS if they want to make money. GPT and Jarvis automatically write the Python code to connect any desired APIs. https://github.com/microsoft/TaskMatrix/tree/main/TaskMatrix.AI
- 👨💻 Microsoft Researchers Propose Low-Code LLM: A Novel Human-LLM Interaction Pattern
-
Track-Anything: a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything and XMem.
microsoft/TaskMatrix (github.com)
- The repository where TaskMatrix.AI will be released just officially changed names from Visual ChatGPT to TaskMatrix. Code is probably coming soon.
What are some alternatives?
stable-diffusion-webui - Stable Diffusion web UI
JARVIS - JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
segment-anything - The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
doctorgpt - DoctorGPT brings GPT into production for application log error diagnosing!
sam-clip - Use Grounding DINO, Segment Anything, and CLIP to label objects in images.
EditAnything - Edit anything in images powered by segment-anything, ControlNet, StableDiffusion, etc. (ACM MM)
XMem - [ECCV 2022] XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model
E2B - Secure cloud runtime for AI apps & AI agents. Fully open-source.
sd-webui-segment-anything - Segment Anything for Stable Diffusion WebUI
deepdoctection - A Repo For Document AI
supercharger - Supercharge Open-Source AI Models
Selefra - The open-source policy-as-code software that provides analysis for Multi-Cloud and SaaS environments, you can get insight with natural language (powered by OpenAI).