Enzyme
tensorflow_macos
Our great sponsors
Enzyme | tensorflow_macos | |
---|---|---|
16 | 33 | |
1,153 | 2,887 | |
3.0% | - | |
9.6 | 3.4 | |
7 days ago | almost 3 years ago | |
LLVM | Shell | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Enzyme
-
Show HN: Curve Fitting Bezier Curves in WASM with Enzyme Ad
Automatic differentiation is done using https://enzyme.mit.edu/
-
Ask HN: What Happened to TensorFlow Swift
lattner left google and was the primary reason they chose swift, so they lost interest.
if you're asking from an ML perspective, i believe the original motivation was to incorporate automatic differentiation in the swift compiler. i believe enzyme is the spiritual successor.
https://github.com/EnzymeAD/Enzyme
-
Show HN: Port of OpenAI's Whisper model in C/C++
https://ispc.github.io/ispc.html
For the auto-differentiation when I need performance or memory, I currently use tapenade ( http://tapenade.inria.fr:8080/tapenade/index.jsp ) and/or manually written gradient when I need to fuse some kernel, but Enzyme ( https://enzyme.mit.edu/ ) is also very promising.
MPI for parallelization across machines.
-
Do you consider making a physics engine (for RL) worth it?
For autodiff, we are currently working again on publishing a new Enzyme (https://enzyme.mit.edu) Frontend for Rust which can also handle pure Rust types, first version should be done in ~ a week.
-
What is a really cool thing you would want to write in Rust but don't have enough time, energy or bravery for?
Have you taken a look at enzymeAD? There is a group porting it to rust.
-
The Julia language has a number of correctness flaws
Enzyme dev here, so take everything I say as being a bit biased:
While, by design Enzyme is able to run very fast by operating within the compiler (see https://proceedings.neurips.cc/paper/2020/file/9332c513ef44b... for details) -- it aggressively prioritizes correctness. Of course that doesn't mean that there aren't bugs (we're only human and its a large codebase [https://github.com/EnzymeAD/Enzyme], especially if you're trying out newly-added features).
Notably, this is where the current rough edges for Julia users are -- Enzyme will throw an error saying it couldn't prove correctness, rather than running (there is a flag for "making a best guess, but that's off by default"). The exception to this is garbage collection, for which you can either run a static analysis, or stick to the "officially supported" subset of Julia that Enzyme specifies.
Incidentally, this is also where being a cross-language tool is really nice -- namely we can see edge cases/bug reports from any LLVM-based language (C/C++, Fortran, Swift, Rust, Python, Julia, etc). So far the biggest code we've handled (and verified correctness for) was O(1million) lines of LLVM from some C++ template hell.
I will also add that while I absolutely love (and will do everything I can to support) Enzyme being used throughout arbitrary Julia code: in addition to exposing a nice user-facing interface for custom rules in the Enzyme Julia bindings like Chris mentioned, some Julia-specific features (such as full garbage collection support) also need handling in Enzyme.jl, before Enzyme can be considered an "all Julia AD" framework. We are of course working on all of these things (and the more the merrier), but there's only a finite amount of time in the day. [^]
[^] Incidentally, this is in contrast to say C++/Fortran/Swift/etc, where Enzyme has much closer to whole-language coverage than Julia -- this isn't anything against GC/Julia/etc, but we just have things on our todo list.
-
Jax vs. Julia (Vs PyTorch)
Idk, Enzyme is pretty next gen, all the way down to LLVM code.
https://github.com/EnzymeAD/Enzyme
-
What's everyone working on this week (7/2022)?
I'm working on merging my build-tool for (oxide)-enzyme into Enzyme itself. Also looking into improving the documentation.
- Wsmoses/Enzyme: High-performance automatic differentiation of LLVM
-
Trade-Offs in Automatic Differentiation: TensorFlow, PyTorch, Jax, and Julia
that seems one of the points of enzyme[1], which was mentioned in the article.
[1] - https://enzyme.mit.edu/
being able in effect do interprocedural cross language analysis seems awesome.
tensorflow_macos
-
Updated Apple Silicon Guide for M2 Pro and M2 Max Chips
https://github.com/apple/tensorflow_macos is no longer needed
-
The hunt for the M1’s neural engine
Tensorflow has a CoreML enabled version which run on ANE.
https://github.com/apple/tensorflow_macos
-
M1 Mac users
Apple released a guide on how to use the M1's integrated Neural Chip in TensorFlow. Have a look at this Apple documentation page (and maybe also this GitHub that talks about TensorFlow together with Apple's own ML Compute platform).
-
MacBook Air or Wait for new potential MacBook Air with M2
Tensorflow does work on Apple Silicon
- Kernels dying when using tensorflow in Jupyter Notebooks.
-
Main PyTorch maintainer confirms that work is being done to support Apple Silicon GPU acceleration for the popular machine learning framework.
Apple did some work to optimize tensorflow for M1, can be found here https://github.com/apple/tensorflow_macos It's alpha, but works fine, I tried it
-
The M1 Max is the fastest GPU we have ever measured in Affinity Photo benchmark
https://github.com/apple/tensorflow_macos/issues/25
https://forums.macrumors.com/threads/apple-silicon-deep-lear...
It is expected that the M1 Max should have similar performance to a RTX-2080 or Titan X.
-
MacBook Pro M1 Pro benchmark
In case anyone is interested, in ran a fairly simple MNIST benchmark (proposed here : https://github.com/apple/tensorflow_macos/issues/25) on my recently acquired M1 Pro MBP (16-core GPU, 16GB RAM).
-
Error while installing tensorflow on Mac M1
The only method I know of to download tensorflow on M1 macs is the one documented here: https://github.com/apple/tensorflow_macos
- How exactly does the Neural Engine benefit the consumer?
What are some alternatives?
Zygote.jl - 21st century AD
miniforge - A conda-forge distribution.
Flux.jl - Relax! Flux is the ML library that doesn't make you tensor
Pointnet_Pointnet2_pytorch - PointNet and PointNet++ implemented by pytorch (pure python) and on ModelNet, ShapeNet and S3DIS.
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
tinygrad - You like pytorch? You like micrograd? You love tinygrad! ❤️ [Moved to: https://github.com/tinygrad/tinygrad]
Lux.jl - Explicitly Parameterized Neural Networks in Julia
ROCm - AMD ROCm™ Software - GitHub Home [Moved to: https://github.com/ROCm/ROCm]
linfa - A Rust machine learning framework.
flamegraph - Easy flamegraphs for Rust projects and everything else, without Perl or pipes <3
faust - Functional programming language for signal processing and sound synthesis
Python-docker - Docker Official Image packaging for Python