cvat
pachyderm
cvat | pachyderm | |
---|---|---|
26 | 8 | |
11,287 | 6,077 | |
- | 0.1% | |
9.8 | 9.8 | |
28 days ago | 1 day ago | |
TypeScript | Go | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cvat
-
Exploring Open-Source Alternatives to Landing AI for Robust MLOps
Another powerful resource is CVAT, the Computer Vision Annotation Tool which supports both image and video annotations with advanced capabilities such as interpolation of shapes between frames, making it highly suitable for computer vision.
-
Need help identifying a good open source data annotation tool
CVAT has an open source repo under MIT license: https://github.com/opencv/cvat I've not worked with it directly but it might be a good place to start.
-
OKENYO - Eyes to the Sky
ref https://github.com/opencv/cvat/issues/6061
-
Way to label yolov7 images fast
an open source annotation tool that integrates object detectors is CVAT https://github.com/opencv/cvat however, using your own detector might require some coding. there is an integration for yolov5, but without modification it only loads the pretrained models.
- [D] Choosing the image labeling tool
-
Segment Anything Model is now available in the open-source CVAT
This integration is currently available in the open-source version of Computer Vision Annotation Tool (http://github.com/opencv/cvat) and coming soon to CVAT.ai cloud (http://cvat.ai/)! Please use it for your computer vision projects to segment images faster.
-
How to build computer vision dataset labeling team in-house
You can download the CVAT docker from a github (Link) and install it yourself, keeping all data local. And here are two options - locally on your personal computer (or company server) or in your own cloud (there are instructions on how to do this with AWS).
-
CVAT Release v2.3.0: Brush tool, WebHooks, and Social auth
In this release, CVAT introduced new features based on our vision and suggestions in the CVAT community, plus addressed more than 20+ reported bugs.
-
CVAT Course. Lecture #3 - Integration
You can find more information here Waiting for your feedback here: Discord, LinkedIn, Gitter, GitHub
pachyderm
-
Open Source Advent Fun Wraps Up!
20. Pachyderm | Github | tutorial
-
Exploring Open-Source Alternatives to Landing AI for Robust MLOps
Pachyderm specializes in creating compliance-focused pipelines that integrate with enterprise-level storage solutions.
-
Show HN: We scaled Git to support 1 TB repos
There are a couple of other contenders in this space. DVC (https://dvc.org/) seems most similar.
If you're interested in something you can self-host... I work on Pachyderm (https://github.com/pachyderm/pachyderm), which doesn't have a Git-like interface, but also implements data versioning. Our approach de-duplicates between files (even very small files), and our storage algorithm doesn't create objects proportional to O(n) directory nesting depth as Xet appears to. (Xet is very much like Git in that respect.)
The data versioning system enables us to run pipelines based on changes to your data; the pipelines declare what files they read, and that allows us to schedule processing jobs that only reprocess new or changed data, while still giving you a full view of what "would" have happened if all the data had been reprocessed. This, to me, is the key advantage of data versioning; you can save hundreds of thousands of dollars on compute. Being able to undo an oopsie is just icing on the cake.
Xet's system for mounting a remote repo as a filesystem is a good idea. We do that too :)
- pachyderm: Data-Centric Pipelines and Data Versioning
-
Awesome list of VCs investing in commercial open-source startups
Pachyderm - License prevents competition.
-
Airflow's Problem
I was at Airbnb when we open-sourced Airflow, it was a great solution to the problems we had at the time. It's amazing how many more use cases people have found for it since then. At the time it was pretty focused on solving our problem of orchestrating a largely static DAG of SQL jobs. It could do other stuff even then, but that was mostly what we were using it for. Airflow has become a victim of its success as it's expanded to meet every problem which could ever be considered a data workflow. The flaws and horror stories in the post and comments here definitely resonate with me. Around the time Airflow was opensource I starting working on data-centric approach to workflow management called Pachyderm[0]. By data-centric I mean that it's focused around the data itself, and its storage, versioning, orchestration and lineage. This leads to a system that feels radically different from a job focused system like Airflow. In a data-centric system your spaghetti nest of DAGs is greatly simplified as the data itself is used to describe most of the complexity. The benefit is that data is a lot simpler to reason about, it's not a living thing that needs to run in a certain way, it just exists, and because it's versioned you have strong guarantees about how it can change.
[0] https://github.com/pachyderm/pachyderm
-
One secret tip for first-time OSS contributors. Shh! 🤫 don't tell anyone else
Here is a demo run of lgtm on pachyderm
- Dud: a tool for versioning data alongside source code, written in Go
What are some alternatives?
label-studio - Label Studio is a multi-type data labeling and annotation tool with standardized output format
flyte - Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
labelImg - LabelImg is now part of the Label Studio community. The popular image annotation tool created by Tzutalin is no longer actively being developed, but you can check out Label Studio, the open source data labeling tool for images, text, hypertext, audio, video and time-series data.
trivy - Find vulnerabilities, misconfigurations, secrets, SBOM in containers, Kubernetes, code repositories, clouds and more
VoTT - Visual Object Tagging Tool: An electron app for building end to end Object Detection Models from Images and Videos.
dud - A lightweight CLI tool for versioning data alongside source code and building data pipelines.
coco-annotator - :pencil2: Web-based image segmentation tool for object detection, localization, and keypoints
beneath - Beneath is a serverless real-time data platform ⚡️
django-rest-framework - Web APIs for Django. 🎸
typhoon-orchestrator - Create elegant data pipelines and deploy to AWS Lambda or Airflow
labelbox-custom-labeling-apps - Explore example custom labeling apps built with Labelbox SDK
tsuru - Open source and extensible Platform as a Service (PaaS).