label-errors
techniques
label-errors | techniques | |
---|---|---|
7 | 9 | |
176 | 7,832 | |
4.5% | 2.7% | |
0.0 | 8.8 | |
over 1 year ago | 4 days ago | |
GNU General Public License v3.0 only | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
label-errors
-
Show HN: 78% MNIST accuracy using GZIP in under 10 lines of code
Sadly,there are several errors in the labeled data, so no one should get 100%.
See https://labelerrors.com/
-
Automated Data Quality at Scale
Sharing some context here: in grad school, I spent months writing custom data analysis code and training ML models to find errors in large-scale datasets like ImageNet, work that eventually resulted in this paper (https://arxiv.org/abs/2103.14749) and demo (https://labelerrors.com/).
Since then, I’ve been interested in building tools to automate this sort of analysis. We’ve finally gotten to the point where a web app can do automatically in a couple of hours what I spent months doing in Jupyter notebooks back in 2019—2020. It was really neat to see the software we built automatically produce the same figures and tables that are in our papers.
The blog post shared here is results-focused, talking about some of the data and dataset-level issues that a tool using data-centric AI algorithms can automatically find in ImageNet, which we used as a case study. Happy to answer any questions about the post or data-centric AI in general here!
P.S. all of our core algorithms are open-source, in case any of you are interested in checking out the code: https://github.com/cleanlab/cleanlab
-
Stanford Cars (cars196) contains many Fine-Grained Errors
I found these issues to be pretty interesting, yet I wasn't surprised. It's pretty well known that many common ML datasets exhibit thousands of errors.
-
[N] Fine-Tuning OpenAI Language Models with Noisily Labeled Data (37% error reduction)
we be benchmarked the minimum (lower bound) of error detection across the ten most commonly used real world ML datasets and found the lower bound is at least 50% accurate. You can see these errors yourself here: labelerrors.com (all found with cleanlab studio, a more advanced version of the algorithms in confident learning) and this was nominated for best paper award at NeurIPS 2021.
-
"I'm gonna make him a Neural Network he can't refuse" - Godfather of AI
twitter should use software that can detect label errors like this... FWIW even many curated ML benchmarks are full of mislabeled data: https://labelerrors.com/
-
How do we best practice preprocessing and data cleaning?
If doing ML, don't forget to check your data for label errors. See for example: https://labelerrors.com/
- How I found nearly 300,000 errors in MS COCO
techniques
- What satellite image analytics are in demand now?
-
Tools for object detection on satellite images
This repo has been useful to me: https://github.com/satellite-image-deep-learning/techniques
-
How to convert big TIF image to smaller jpgs
Here's an extensive github collection on anything related https://github.com/robmarkcole/satellite-image-deep-learning
- Deep Learning for Remote Sensing
- If you want to learn about Machine Learning on Satellite Imagery, this constantly updated github repo has links to hundreds of different tutorials
- CNN in satellite images
-
Sony teases ‘breakthrough AI project’ created with Gran Turismo studio Polyphony
Out of pure curiousity I checked and though theres a bunch of specialised categorisation/segmentation tools like the ones in the link, I didn't find any explicitly for generating realtime 3d assets: https://github.com/robmarkcole/satellite-image-deep-learning
- robmarkcole/satellite-image-deep-learning: Resources for deep learning with satellite & aerial imagery (incredibly comprehensive)
- Skills for a career in Remote Sensing?
What are some alternatives?
mnist_1_pt_2 - 1.2% test error on MNIST using only least squares and numpy calls.
awesome-satellite-imagery-datasets - 🛰️ List of satellite image training datasets with annotations for computer vision and deep learning