oxide-enzyme
JuliaInterpreter.jl
Our great sponsors
oxide-enzyme | JuliaInterpreter.jl | |
---|---|---|
4 | 5 | |
102 | 157 | |
- | 1.9% | |
2.9 | 7.7 | |
about 1 year ago | 9 days ago | |
Rust | Julia | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
oxide-enzyme
-
Enzyme: towards state-of-the-art AutoDiff in Rust
Afterwards, you can have a look at https://github.com/rust-ml/oxide-enzyme, where I published some toy examples. The current approach has a lot of limitations, mostly due to using the ffi / c-abi to link the generated functions. @bytesnake and I are already looking at an alternative implementation which should solve most, if not all issues. For the meantime, we hope that this already helps those who want to do some early testing. This link might also help you to understand the Rust frontend a bit better. I will add a larger blog post once oxide-enzyme is ready to be published on crates.io.
- Oxide-Enzyme: Integrating LLVM's Static Automatic Differentiation Plugin
- Julia 1.7 has been released
JuliaInterpreter.jl
-
Do you use Julia for general purpose tasks?
The projects page is a list of suggestions of projects that someone has already said they want to run. If you can find a mentor, you can submit a project for anything. For potential performance improvements, I'd look at https://github.com/JuliaDebug/JuliaInterpreter.jl/issues/206, https://github.com/JuliaDebug/JuliaInterpreter.jl/issues/312, and https://github.com/JuliaDebug/JuliaInterpreter.jl/issues/314. I'm not sure if Tim Holy or Kristoffer have time to mentor a project, but if you're interested in doing a gsoc, ask around in the Julia slack/zulip, and you might be able to find a mentor.
-
Julia 1.7 has been released
I would not go as far as calling it very naive, there has certainly been some work put into optimizing performance within the current design.
There are probably some gains to be had by using a different storage format for the IR though as proposed in [1], but it is difficult to say how much of a difference that will make in practice.
[1] https://github.com/JuliaDebug/JuliaInterpreter.jl/pull/309
-
What's Bad about Julia?
You're right, done some more research and there seems to be an interpreter in the compiler: https://github.com/JuliaDebug/JuliaInterpreter.jl. It's only enabled by putting an annotation, and is mainly used for the debugger, but it's still there.
Still, it still seems to try executing the internal SSA IR in its raw form (which is more geared towards compiling rather than dynamic execution in a VM). I was talking more towards a conventional bytecode interpreter (which you can optimize the hell out of it like LuaJIT did). A bytecode format that is carefully designed for fast execution (in either a stack-based or register-based VM) would be much better for interpreters, but I'm not sure if Julia's language semantics / object model can allow it. Maybe some intelligent people out there can make the whole thing work, is what I was trying to say.
-
Julia: faster than Fortran, cleaner than Numpy
It could, but that is a lot more work than it sounds. It might be easier to make it possible to swap out the compiler for one that is much faster (LLVM is slow but does good optimisations, other compilers like cranelift are faster but produce slower code). There is a Julia interpreter but it was written in Julia itself (it was written to support debuggers), so it doesn't really solve the latency issues.
-
Julia: Faster than Fortran, cleaner than Numpy
If you need to run small scripts and can't switch to a persistent-REPL-based workflow, you might consider starting Julia with the `--compile=min` option. You can also reduce startup times dramatically by building a sysimg with PackageCompiler.jl
There is also technically an interpreter if you want to go that way [1], so in principle it might be possible to do the same trick javascript does, but someone would have to implement that.
What are some alternatives?
DiffEqOperators.jl - Linear operators for discretizations of differential equations and scientific machine learning (SciML)
Diffractor.jl - Next-generation AD
Enzyme - High-performance automatic differentiation of LLVM and MLIR.
DaemonMode.jl - Client-Daemon workflow to run faster scripts in Julia