datasets
numpyro
Our great sponsors
| datasets | numpyro | |
|---|---|---|
| 5 | 2 | |
| 4,175 | 2,039 | |
| 1.5% | 1.8% | |
| 9.4 | 8.7 | |
| 4 days ago | 9 days ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datasets
-
TensorFlow Datasets (TFDS): a collection of ready-to-use datasets
I tried Librispeech, a very common dataset for speech recognition, in both HF and TFDS.
TFDS performed extremely bad.
First it failed because the official hosting server only allows 5 simultaneous connections, and TFDS totally ignored that and makes up to 50 simultaneous downloads and that breaks. I wonder if anyone actually tested this?
Then you need to have some computer with 30GB to do the preparation, which might fail on your computer. This is where I stopped. https://github.com/tensorflow/datasets/issues/3887. It might be fixed now but it took them 8 months to respond to my issue.
On HF, it just worked. There was a smaller issue in how the dataset was split up but that is fixed now, and their response was very fast and great.
-
We built a pi controlled hydroponics box that grows your plants 1.5x faster using ML
but it looks like none of your plants are supported by the plantvillage model, or do I understand something wrong? https://github.com/tensorflow/datasets/blob/master/tensorflow_datasets/image_classification/plant_village.py#L57
-
Voice Recognition with Tensorflow
To do our example, we're going to use some audio files released by Google.
numpyro
- Bayesian Analysis with Python
-
Saving the World with Bayesian Modeling
Perhaps an alternative to look into: Numpyro [1] has a JAX backend so can be really fast when compiled; and it can run on GPUs. So that might be helpful for your problem with loads of data.
[1] https://github.com/pyro-ppl/numpyro
What are some alternatives?
Activeloop Hub - Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets. Stream data real-time to PyTorch/TensorFlow. https://activeloop.ai [Moved to: https://github.com/activeloopai/deeplake]
PyMC - Bayesian Modeling and Probabilistic Programming in Python
flax - Flax is a neural network library for JAX that is designed for flexibility.
trax - Trax — Deep Learning with Clear Code and Speed
jax-models - Unofficial JAX implementations of deep learning research papers
einops - Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
FedScale - FedScale is a scalable and extensible open-source federated learning (FL) platform.
pyprobml - Python code for "Probabilistic Machine learning" book by Kevin Murphy
BayesianEcosystems_IAP - Notes and code for Bayesian ecosystem modeling IAP course
jaxopt - Hardware accelerated, batchable and differentiable optimizers in JAX.
Bayeslite - BayesDB on SQLite. A Bayesian database table for querying the probable implications of data as easily as SQL databases query the data itself.