velox
substrait
velox | substrait | |
---|---|---|
6 | 3 | |
3,151 | 1,038 | |
2.0% | 3.7% | |
10.0 | 8.8 | |
4 days ago | 3 days ago | |
C++ | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
velox
- Meta Velox: A C++ vectorized database acceleration library
- FLaNK Stack for 04 December 2023
- A C++ vectorized database acceleration library
- Velox: An open source unified execution engine
- A new C++ vectorized DB acceleration library, optimizing query engines
-
Substrait: Cross-Language Serialization for Relational Algebra
4. The workers (if distributed) or the engine (if single-box) executing the execution plan, by performing the actual computations on actual bytes.
(Note that this is a cartoon version and any given engine will have differences, eg Presto/Trino does not have a clear distinction between LP and Physical Plan.)
1) and 4) are broadly similar across engines, while 2) and 3) vary widely partially because of different requirements (reliability, latency, etc). Projects such as Apache Arrow and Velox (https://github.com/facebookincubator/velox) are making common tools for 4), and as mentioned ANSI SQL, ZetaSQL, Calcite, and Substrait are making common tools for 1).
substrait
-
Velox: Meta's Unified Execution Engine [pdf]
Python's Substrait seems like the biggest/most-used competitor-ish out there. I'd love some compare & contrast; my sense is that Substrait has a smaller ambition, and more wants to be a language for talking about execution rather than a full on execution engine. https://github.com/substrait-io/substrait
We can also see from the DataFusion discussion that they too see themselves as a bit of a Velox competitor. https://github.com/apache/arrow-datafusion/discussions/6441
- Parallel Grouped Aggregation in DuckDB
- Substrait: Cross-Language Serialization for Relational Algebra
What are some alternatives?
dwl - dwm for Wayland - ARCHIVE: development has moved to Codeberg
tenzir - Open source security data pipelines.
wayland - Core Wayland protocol and libraries (mirror)
swc - a library for making a simple Wayland compositor
dwm - LEV Linux's window manager (a fork of dwm)
wlr-randr - An xrandr clone for wlroots compositors
waymonad - A wayland compositor based on ideas from and inspired by xmonad
sway - i3-compatible Wayland compositor
vivarium - A dynamic tiling Wayland compositor using wlroots
void-packages - The Void source packages collection
Elasticsearch - Free and Open, Distributed, RESTful Search Engine
samurai - ninja-compatible build tool written in C