SaaSHub helps you find the best software and product alternatives Learn more →
webdataset Open-Source Projects
-
webdataset
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
-
Scout Monitoring
Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
Project mention: How to use data stored in a (private) S3 Bucket for training? | /r/pytorch | 2023-07-21As an alternative, I've looked into using WebDataset, but couldn't figure out how to access data that is stored in a private bucket.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
webdataset discussion
webdataset related posts
-
How to use data stored in a (private) S3 Bucket for training?
-
[D] Title: Best tools and frameworks for working with million-billion image datasets?
-
[D] Training networks on extremely large datasets (10+TB)?
-
Question: TIFF image dataset - size in RAM.
-
How to upload large amounts of data to a server?
-
Does mit 6.824 help for distributed deep learning?
-
How to effectively load a large text dataset with PyTorch?
-
A note from our sponsor - SaaSHub
www.saashub.com | 12 Jun 2024
Index
| Project | Stars | |
|---|---|---|
| 1 | webdataset | 2,033 |
Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com