webdataset
ModelNet40-C
Our great sponsors
| webdataset | ModelNet40-C | |
|---|---|---|
| 7 | 2 | |
| 1,962 | 201 | |
| 7.4% | - | |
| 8.8 | 0.0 | |
| 17 days ago | 8 months ago | |
| Python | Python | |
| BSD 3-clause "New" or "Revised" License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
webdataset
-
How to use data stored in a (private) S3 Bucket for training?
As an alternative, I've looked into using WebDataset, but couldn't figure out how to access data that is stored in a private bucket.
- [D] Title: Best tools and frameworks for working with million-billion image datasets?
-
[D] Training networks on extremely large datasets (10+TB)?
You can try webdataset (https://github.com/webdataset/webdataset).
- Question: TIFF image dataset - size in RAM.
-
How to upload large amounts of data to a server?
compress it to .tar format and then load it as a webdataset
-
Does mit 6.824 help for distributed deep learning?
Would guess not but there should be some good niche resources: check out the introductory videos here https://github.com/webdataset/webdataset
-
How to effectively load a large text dataset with PyTorch?
I found a pretty good solution that is similar to the TFRecord from Tensorflow. You just need to load the data, tokenized it, and save the arrays in shards with webdataset package.
ModelNet40-C
-
[R] NEW Robustness Benchmark for 3D Point Cloud Recognition, ModelNet40-C. "Benchmarking Robustness of 3D Point Cloud Recognition Against Common Corruptions"
Code for https://arxiv.org/abs/2201.12296 found: https://github.com/jiachens/ModelNet40-C
What are some alternatives?
Practical_RL - A course in reinforcement learning in the wild
ronin - RoNIN: Robust Neural Inertial Navigation in the Wild
NYU-DLSP20 - NYU Deep Learning Spring 2020
LFattNet - Attention-based View Selection Networks for Light-field Disparity Estimation
Made-With-ML - Learn how to design, develop, deploy and iterate on production-grade ML applications.
torchio - Medical imaging toolkit for deep learning
ffcv - FFCV: Fast Forward Computer Vision (and other ML workloads!)
tapnet - Tracking Any Point (TAP)
fastai - The fastai deep learning library
yolo-tf2 - yolo(all versions) implementation in keras and tensorflow 2.x
PySyft - Perform data science on data that remains in someone else's server
natural-adv-examples - A Harder ImageNet Test Set (CVPR 2021)