geni-performance-benchmark
geni
geni-performance-benchmark | geni | |
---|---|---|
3 | 4 | |
27 | 275 | |
- | 0.7% | |
4.1 | 5.6 | |
over 3 years ago | 5 months ago | |
Clojure | Clojure | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
geni-performance-benchmark
-
PyTorch: Where we are headed and why it looks a lot like Julia (but not exactly)
Clojure has a high performance data frame library that leverages new JVM vector API and high quality apache arrow protocol.
Talk related - https://youtu.be/5mUGu4RlwKE
https://github.com/zero-one-group/geni-performance-benchmark
- LLVM!
-
Clojure High Performance Data Processing System
How often have you seen a Clojure system that soundly beats C, Julia, Python, Spark, and R systems in a data processing benchmark?
geni
-
Spark Anyone?
sparkling is fine. there is also geni
- LLVM!
-
Scala is a Maintenance Nightmare
I haven't tried Spark from Kotlin, but it's a nice experience working with it in Clojure, and I have yet to see a language more expressive than Clojure. :)
-
Data engineering and Clojure?
I think for the large scale stuff, wrappers like geni are pretty nice and built on top of established tech. There were several distributed computing platforms like onyx and storm that popped up in clojure as well that may be interesting to look at. clojure toolbox has a good index of libraries to examine.
What are some alternatives?
jax - Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
tech.ml.dataset - A Clojure high performance data processing system
HTTP.jl - HTTP for Julia
jackdaw - A Clojure library for the Apache Kafka distributed streaming platform.
tablecloth - Dataset manipulation library built on the top of tech.ml.dataset
holy-lambda - The extraordinary simple, performant, and extensible custom AWS Lambda runtime for Clojure.
kotlinx.collections.immutable - Immutable persistent collections for Kotlin
functorch - functorch is JAX-like composable function transforms for PyTorch.
notespace - using your namespace as a notebook
TailRec.jl - A tail recursion optimization macro for julia.
frovedis - Framework of vectorized and distributed data analytics