fast-soft-sort
thinc
fast-soft-sort | thinc | |
---|---|---|
1 | 4 | |
545 | 2,796 | |
0.7% | 0.5% | |
1.8 | 7.6 | |
3 months ago | 7 days ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fast-soft-sort
-
[P] Torchsort - Fast, differentiable sorting and ranking in PyTorch
The original implementation (https://github.com/google-research/fast-soft-sort) uses numba for the forward pass and pure python for the backwards pass, while Torchsort has both implemented in C++/CUDA with additional parallelization over the batch dimension. You can find some benchmarks in the Torchsort readme.
thinc
-
JAX – NumPy on the CPU, GPU, and TPU, with great automatic differentiation
Agree, though I wouldn’t call PyTorch a drop-in for NumPy either. CuPy is the drop-in. Excepting some corner cases, you can use the same code for both. Thinc’s ops work with both NumPy and CuPy:
https://github.com/explosion/thinc/blob/master/thinc/backend...
-
Tinygrad: A simple and powerful neural network framework
I love those tiny DNN frameworks, some examples that I studied in the past (I still use PyTorch for work related projects) :
thinc.by the creators of spaCy https://github.com/explosion/thinc
-
good examples of functional-like python code that one can study?
thinc - defining neural nets in functional way jax, a new deep learning framework puts emphasis on functions rather than tensors, I've tested it for a couple of applications and it's really cool, you can write stuff like you'd write math expressions in papers using numpy. That speeds up development significantly, and makes code much more readable
- thinc - A refreshing functional take on deep learning, compatible with your favorite libraries
What are some alternatives?
google-research - Google Research
quantulum3 - Library for unit extraction - fork of quantulum for python3
torchsort - Fast, differentiable sorting and ranking in PyTorch
jax - Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
horovod - Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
einops - Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
extending-jax - Extending JAX with custom C++ and CUDA code
ivy - The Unified AI Framework
dm-haiku - JAX-based neural network library
AIF360 - A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
textacy - NLP, before and after spaCy