opteryx
sqlglot
opteryx | sqlglot | |
---|---|---|
1 | 56 | |
43 | 5,573 | |
- | - | |
9.8 | 9.9 | |
6 days ago | 1 day ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
opteryx
-
Pure Python Distributed SQL Engine
Thanks for sharing.
I have a SQL Engine in Python too (https://github.com/mabel-dev/opteryx). I focused my initial effort on supporting SQL statements and making the usage feel like a database - that probably reflects the problem I had in front of me when I set out - only handling handfuls of gigabytes in a batch environment for ETLs with a group of new-to-data-engineering engineers. Have recently started looking more at real-time performance, such as distributing work. Am interesting in how you've approached.
sqlglot
-
The Future of MySQL is PostgreSQL: an extension for the MySQL wire protocol
This is probably referring to "zero changes to your driver code" and not "zero changes to the SQL you send over this driver".
Translating between SQL dialects is notoriously hard and attempts to translate [1] are working in 95% of cases. But the last 5% would require 5x amount of work. That's because "SQL dialect" also includes weird edge cases of type inference of things like COALESCE(5, FALSE) and emulation of system catalogs (pg_catalog, information_schema).
[1] https://github.com/tobymao/sqlglot
- FLaNK AI Weekly 18 March 2024
- SQLGlot: No-dependency SQL parser, transpiler, optimizer for 21 SQL dialects
-
Transpile Any SQL to PostgreSQL Dialect
Recommend checking out https://github.com/tobymao/sqlglot if you are interested in this capability for other SQL dialects
Tools like this are helpful for:
- Rendering SQL in a consistent way, eg for snapshot testing
-
This Week In Python
sqlglot – Python SQL Parser and Transpiler
- SQLglot: Python SQL Parser and Transpiler
-
Build the dependency graph of your BigQuery pipelines at no cost: a Python implementation
In the project we used Python lib networkx and a DiGraph object (Direct Graph). To detect a table reference in a Query, we use sqlglot, a SQL parser (among other things) that works well with Bigquery.
- A Primer on SQLGlot's Abstract Syntax Tree
-
Show HN: SQL Polyglot
Cool! Is this built with sqlglot[1] on the back end?
[1] https://github.com/tobymao/sqlglot
-
sqlglot - Amazing SQL parsing library
Wanted to give sqlglot a shoutout as it saved me a ton of time.
What are some alternatives?
quokka - Making data lake work for time series
sqloxide - Python bindings for sqlparser-rs
nomad - Deprecated and re-branded as Alto
JSqlParser - JSqlParser parses an SQL statement and translate it into a hierarchy of Java classes. The generated hierarchy can be navigated using the Visitor Pattern
influxdb3-python - Python module that provides a simple and convenient way to interact with InfluxDB 3.0.
Transcrypt - Python 3.9 to JavaScript compiler - Lean, fast, open! -
pg8000 - A Pure-Python PostgreSQL Driver
zetasql - ZetaSQL - Analyzer Framework for SQL
datafusion-ballista - Apache Arrow Ballista Distributed Query Engine
duckdb - DuckDB is an in-process SQL OLAP Database Management System
emr-serverless-samples - Example code for running Spark and Hive jobs on EMR Serverless.
criterion.rs - Statistics-driven benchmarking library for Rust