Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Autograd Open-Source Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
interviews.ai
It is my belief that you, the postgraduate students and job-seekers for whom the book is primarily meant will benefit from reading it; however, it is my hope that even the most experienced researchers will find it fascinating as well.
-
pennylane
PennyLane is a cross-platform Python library for differentiable programming of quantum computers. Train a quantum computer the same way as a neural network.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
machine_learning_refined
Notes, examples, and Python demos for the 2nd edition of the textbook "Machine Learning Refined" (published by Cambridge University Press).
-
Arraymancer
A fast, ergonomic and portable tensor library in Nim with a deep learning focus for CPU, GPU and embedded devices via OpenMP, Cuda and OpenCL backends
-
DL4S
Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux
-
corgi
A neural network, and tensor dynamic automatic differentiation implementation for Rust. (by patricksongzy)
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
TensorFlow, developed by Google, and PyTorch, developed by Facebook, are two of the most popular frameworks for building and training complex machine learning models. TensorFlow is known for its flexibility and robust scalability, making it suitable for both research prototypes and production deployments. PyTorch is praised for its ease of use, simplicity, and dynamic computational graph that allows for more intuitive coding of complex AI models. Both frameworks support a wide range of AI models, from simple linear regression to complex deep neural networks.
See also https://github.com/unifyai/ivy which I have not tried but seems along the lines of what you are describing, working with all the major frameworks
Project mention: MatX: Efficient C++17 GPU numerical computing library with Python-like syntax | news.ycombinator.com | 2023-10-03I think a comparison to PyTorch, TensorFlow and/or JAX is more relevant than a comparison to CuPy/NumPy.
And then maybe also a comparison to Flashlight (https://github.com/flashlight/flashlight) or other C/C++ based ML/computing libraries?
Also, there is no mention of it, so I suppose this does not support automatic differentiation?
It is a small DSL written using macros at https://github.com/mratsim/Arraymancer/blob/master/src/array....
Nim has pretty great meta-programming capabilities and arraymancer employs some cool features like emitting cuda-kernels on the fly using standard templates depending on backend !
Project mention: Owl project (OCaml scientific computing) formally concluded | news.ycombinator.com | 2024-02-19
Project mention: Custos – A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine | news.ycombinator.com | 2024-03-01
Project mention: Yagrad – 100 SLOC autograd engine with complex numbers and fixed DAG | news.ycombinator.com | 2024-03-17
Autograd related posts
- penzai: JAX research toolkit for building, editing, and visualizing neural nets
- Shape Typing in Python
- Tinygrad: Hacked 4090 driver to enable P2P
- Functions and operators for Dot and Matrix multiplication and Element-wise calculation in PyTorch
- Building a GPT Model from the Ground Up!
- Best AI Tools for Students Learning Development and Engineering
- Bash Debugging
-
A note from our sponsor - InfluxDB
www.influxdata.com | 25 Apr 2024
Index
What are some of the best open-source Autograd projects? This list will help you:
Project | Stars | |
---|---|---|
1 | Pytorch | 77,783 |
2 | ivy | 14,022 |
3 | flashlight | 5,145 |
4 | MegEngine | 4,713 |
5 | interviews.ai | 4,437 |
6 | Deep Java Library (DJL) | 3,841 |
7 | pennylane | 2,113 |
8 | dfdx | 1,607 |
9 | machine_learning_refined | 1,584 |
10 | Arraymancer | 1,304 |
11 | awesome-jax | 1,274 |
12 | owl | 1,178 |
13 | pytorch_sparse | 950 |
14 | norse | 611 |
15 | neograd | 230 |
16 | MyGrad | 186 |
17 | bottle | 146 |
18 | vtl | 139 |
19 | DL4S | 100 |
20 | custos | 60 |
21 | vim-autograd | 26 |
22 | yagrad | 25 |
23 | corgi | 23 |
Sponsored