datafusion-python
sqlparser-rs
| datafusion-python | sqlparser-rs | |
|---|---|---|
| 3 | 12 | |
| 299 | 2,468 | |
| 6.7% | 2.9% | |
| 8.4 | 9.3 | |
| 7 days ago | 1 day ago | |
| Rust | Rust | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datafusion-python
-
Pure Python Distributed SQL Engine
hmm I wasn't aware of https://github.com/apache/arrow-datafusion-python... thanks for the pointer.
time series target release by April this year. main challenge is supporting them in the SQL API -- execution engine support is already done
sqlparser-rs
-
Introducing SQLPage : write websites entirely in SQL
sqlparser to parse SQL queries and detect variable bindings
-
Understanding the SQL AST and what can be done with it
So to start with this, I looked into SQL parsing and found this library https://github.com/sqlparser-rs/sqlparser-rs
-
Supabase Logs: open source logging server
We switched to an open source alternative, the rust-based sqlparser-rs library, contributing a few updates for the BigQuery dialect.
- Parsing SQL with Rust
-
Writing a SQL LS in Rust - Looking for Coding Companions.
I have experience with sqlparser-rs (for my sqlpage project), but it does not track the source code location of the parsed data structures (yet).
-
Pure Python Distributed SQL Engine
It uses https://github.com/sqlparser-rs/sqlparser-rs as the parser and lexer. The binder, planner, optimizer and executor are in Python. The optimizer stage only works on the logical plan and the rules are heuristic only.
-
Parsing / Recursive Descent Parser
That code could be copied directly from some real-world examples - sqlparser-rs code looks pretty much exactly the same.
https://github.com/sqlparser-rs/sqlparser-rs
-
RisingLight is an OLAP database system for educational purpose
Also neat to find the SQL parser library they use.
- We Went All in on Sqlc/Pgx for Postgres and Go
- “Swift is the only language I could find with over 100 keywords”
What are some alternatives?
sqlglot - Python SQL Parser and Transpiler
sled - the champagne of beta embedded databases
opteryx - 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.
goyesql - Parse SQL files with multiple named queries and automatically prepare and scan them into structs.
pg8000 - A Pure-Python PostgreSQL Driver
sqlite
datafusion-ballista - Apache Arrow Ballista Distributed Query Engine
kube - Rust Kubernetes client and controller runtime
quokka - Making data lake work for time series
prettytable-rs - A rust library to print aligned and formatted tables
go - The Go programming language
pggen - A database first code generator focused on postgres