fastdup
albumentations
fastdup | albumentations | |
---|---|---|
18 | 28 | |
1,408 | 13,425 | |
1.0% | 0.9% | |
9.4 | 8.9 | |
29 days ago | 5 days ago | |
Python | Python | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fastdup
-
Visualize your dataset using DINOv2 embedding
Visualizing your dataset (especially large ones) in a low-dimensional embedding space can tell you a lot about the patterns and clusters in your dataset.
We recently release a notebook showing how you can visualize your dataset using DINOv2 models by running it on your CPU.
Yes! No GPUs needed.
We used it to find clusters of similar images, duplicates, and outliers in a subset of the LAION dataset
Try it on your own dataset:
Colab notebook - https://colab.research.google.com/github/visual-layer/fastdup/blob/main/examples/dinov2_notebook.ipynb
GitHub repo - https://github.com/visual-layer/fastdup
-
[R][P] How to extract feature vectors of large datasets using DINOv2 on CPU
Run 1M images from the LAION dataset through the DINOv2 model and cluster the images using a free tool - fastdup.
-
Computer Vision pre-trained model for finding how similar two photos of a room are
Another option could be fastdup (https://github.com/visual-layer/fastdup) which is probably most helpful for analysis type objectives.
-
Find image duplicates and outliers – A free, scalable, efficient tool
I recently stumbled upon fastdup a tool that lets you gain insights from a large image/video collection.
-
How can we match images in our database?
There is this fastdup framework which supposedly allows you to find duplicates and similar images. i haven't used it though
-
Measure Images Similarity
I came across fastdup recently https://github.com/visual-layer/fastdup
- Dedup-ing LAION (60M duplicates) and ImageNet (1.2M duplicates) with fastdup
- [R] Dedup-ing LAION (60M duplicates) and ImageNet (1.2M duplicates) with fastdup
albumentations
-
Augment specific classes?
You can use albumentations if you are comfortable with using open source libraries https://github.com/albumentations-team/albumentations
-
Ask HN: What side projects landed you a job?
One of the members of the core team of our open-source library https://albumentations.ai/
It was not the only reason he was hired; it was a solid addition to his already good performance at the interviews.
Or at least that is what the hiring manager later said.
-
The Lack of Compensation in Open Source Software Is Unsustainable
I am one of the creators and maintainers of https://albumentations.ai/.
- 12800+ stars
-
Burn Deep Learning Framework Release 0.7.0: Revamped (de)serialization, optimizer & module overhaul, initial ONNX support and tons of new features.
Is something planned to support data augmentations? Something like https://albumentations.ai/
-
How to label augmented images for training YOLO algorithm?
Here you go: https://albumentations.ai/
-
Unstable Diffusion bounces back with $19,000 raised in one day, by using Stripe
I think they should use some data augmentation techniques like I am using for Infinity AI if you wanna see more here. Note that most of these do not work for image generation.
-
Tokyo Drift : detecting drift in images with NannyML and Whylogs
Our second approach was a more automated one. Here the idea was to try out an image augmentation library, Albumentations, and use it for adversarial attacks. This time, instead of one-shot images, we applied the transformations at random time ranges. We chose for these transformations also to be more subtle than then one-shot images, such as vertical flips, grayscaling, downscaling, …
-
[D] Improve machine learning with same number of images
Check out albumentations. If your use case is segmentation, check out the offline augmentation of this project
-
What are the best programs/scripts for image augmentation of YOLO5 training dataset. Something like roboflow but free)
I think this is the most popular open source project: https://github.com/albumentations-team/albumentations
-
To get dataset for face image restoration.
You can also curate your own dataset by using open source images (https://universe.roboflow.com/search?q=faces%20images%3E1000) and open source augmentations (https://github.com/albumentations-team/albumentations). Or you can do use the augmentation UI (https://docs.roboflow.com/image-transformations/image-augmentation) to apply noise, blurring, shear, crop, etc.
What are some alternatives?
sahi - Framework agnostic sliced/tiled inference + interactive ui + error analysis plots
imgaug - Image augmentation for machine learning experiments.
computervision-recipes - Best Practices, code samples, and documentation for Computer Vision.
YOLO-Mosaic - Perform mosaic image augmentation on data for training a YOLO model
pyod - A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)
labelme2coco - A lightweight package for converting your labelme annotations into COCO object detection format.
dhash - Python library to calculate the difference hash (perceptual hash) for a given image, useful for detecting duplicates
autoalbument - AutoML for image augmentation. AutoAlbument uses the Faster AutoAugment algorithm to find optimal augmentation policies. Documentation - https://albumentations.ai/docs/autoalbument/
CVPR2024-Papers-with-Code - CVPR 2024 论文和开源项目合集
Mask-RCNN-TF2 - Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow 2.0
plakakia - Python image tiling library for image processing, object detection, etc.
BlenderProc - A procedural Blender pipeline for photorealistic training image generation