geni
geni-performance-benchmark
geni | geni-performance-benchmark | |
---|---|---|
4 | 3 | |
275 | 27 | |
0.7% | - | |
5.6 | 4.1 | |
5 months ago | over 3 years ago | |
Clojure | Clojure | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
geni
-
Spark Anyone?
sparkling is fine. there is also geni
- LLVM!
-
Scala is a Maintenance Nightmare
I haven't tried Spark from Kotlin, but it's a nice experience working with it in Clojure, and I have yet to see a language more expressive than Clojure. :)
-
Data engineering and Clojure?
I think for the large scale stuff, wrappers like geni are pretty nice and built on top of established tech. There were several distributed computing platforms like onyx and storm that popped up in clojure as well that may be interesting to look at. clojure toolbox has a good index of libraries to examine.
geni-performance-benchmark
-
PyTorch: Where we are headed and why it looks a lot like Julia (but not exactly)
Clojure has a high performance data frame library that leverages new JVM vector API and high quality apache arrow protocol.
Talk related - https://youtu.be/5mUGu4RlwKE
https://github.com/zero-one-group/geni-performance-benchmark
- LLVM!
-
Clojure High Performance Data Processing System
How often have you seen a Clojure system that soundly beats C, Julia, Python, Spark, and R systems in a data processing benchmark?
What are some alternatives?
tech.ml.dataset - A Clojure high performance data processing system
jax - Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
jackdaw - A Clojure library for the Apache Kafka distributed streaming platform.
HTTP.jl - HTTP for Julia
holy-lambda - The extraordinary simple, performant, and extensible custom AWS Lambda runtime for Clojure.
tablecloth - Dataset manipulation library built on the top of tech.ml.dataset
kotlinx.collections.immutable - Immutable persistent collections for Kotlin
notespace - using your namespace as a notebook
functorch - functorch is JAX-like composable function transforms for PyTorch.
frovedis - Framework of vectorized and distributed data analytics
TailRec.jl - A tail recursion optimization macro for julia.