sqlglot
criterion.rs
Our great sponsors
| sqlglot | criterion.rs | |
|---|---|---|
| 56 | 30 | |
| 5,511 | 4,153 | |
| - | - | |
| 9.9 | 6.5 | |
| about 20 hours ago | 12 days ago | |
| Python | Rust | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sqlglot
-
The Future of MySQL is PostgreSQL: an extension for the MySQL wire protocol
This is probably referring to "zero changes to your driver code" and not "zero changes to the SQL you send over this driver".
Translating between SQL dialects is notoriously hard and attempts to translate [1] are working in 95% of cases. But the last 5% would require 5x amount of work. That's because "SQL dialect" also includes weird edge cases of type inference of things like COALESCE(5, FALSE) and emulation of system catalogs (pg_catalog, information_schema).
[1] https://github.com/tobymao/sqlglot
- FLaNK AI Weekly 18 March 2024
- SQLGlot: No-dependency SQL parser, transpiler, optimizer for 21 SQL dialects
-
Transpile Any SQL to PostgreSQL Dialect
Recommend checking out https://github.com/tobymao/sqlglot if you are interested in this capability for other SQL dialects
Tools like this are helpful for:
- Rendering SQL in a consistent way, eg for snapshot testing
-
This Week In Python
sqlglot – Python SQL Parser and Transpiler
- SQLglot: Python SQL Parser and Transpiler
-
Build the dependency graph of your BigQuery pipelines at no cost: a Python implementation
In the project we used Python lib networkx and a DiGraph object (Direct Graph). To detect a table reference in a Query, we use sqlglot, a SQL parser (among other things) that works well with Bigquery.
- A Primer on SQLGlot's Abstract Syntax Tree
-
Show HN: SQL Polyglot
Cool! Is this built with sqlglot[1] on the back end?
[1] https://github.com/tobymao/sqlglot
-
sqlglot - Amazing SQL parsing library
Wanted to give sqlglot a shoutout as it saved me a ton of time.
criterion.rs
-
How to benchmark in Rust with libtest bench
The three popular options for benchmarking in Rust are: libtest bench, Criterion, and Iai.
-
Divan: Fast and Simple Benchmarking for Rust
Holy crap. I was just writing a blog to complain about the state of Rust benchmarking and I think this might address most of my points. The biggest one is the ability to have benchmarks collocated within the library like tests which is the biggest annoyance.
It’s also nice to see that it can report multiple counters in parallel. I put up a similar feature[1] for criterion recently but I fear the project isn’t being maintained anymore…
Haven’t looked deeply into divan yet but the other requirements I have for criterion’s power is to run tests with statistical guarantees on the results, terminate quickly when statistical significance is reached (—quick), provide a comparison of the delta from a previous benchmark, and to run async code. Wonder how this stacks up.
[1] https://github.com/bheisler/criterion.rs/pull/722
-
how expensive is an operation?
criterion for benchmarks,
- Autometrics 0.4: Spot commits that introduce errors or slow down your application
- Performance-related question
-
How can I further optimize this file parser? (std, serde, diesel)
For an extra optimization, you might look into techniques like branchless code, turning array of structs into struct of arrays for better cache utilization/lowering branch mispredictions. There is many talks on YouTube how to actually measure and improve performance of native code. And for rust there is a criterion.rs for benchmarking.
- making a virtual machine in rust
-
How much does Rust's bounds checking cost?
https://github.com/bheisler/criterion.rs is good for tests like that. It will give you much more than a single number and handle things like outliers. This makes identifying noisy tests simpler.
-
Tips in using criterion to properly benchmark a database?
I have tried many ways but I think is not possible. I put it on https://github.com/bheisler/criterion.rs/issues/631.
-
Rust 1.64 Became 10-20% Faster On Windows
Criterion is still the gold standard.
Pros for Criterion over the stdlib: https://github.com/bheisler/criterion.rs#features
Downsides of Criterion: https://bheisler.github.io/criterion.rs/book/user_guide/know...
What are some alternatives?
sqloxide - Python bindings for sqlparser-rs
hyperfine - A command-line benchmarking tool
JSqlParser - JSqlParser parses an SQL statement and translate it into a hierarchy of Java classes. The generated hierarchy can be navigated using the Visitor Pattern
glassbench - A micro-benchmark framework to use with cargo bench
Transcrypt - Python 3.9 to JavaScript compiler - Lean, fast, open! -
sccache - Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.
zetasql - ZetaSQL - Analyzer Framework for SQL
tracing - Application level tracing for Rust.
duckdb - DuckDB is an in-process SQL OLAP Database Management System
tungstenite-rs - Lightweight stream-based WebSocket implementation for Rust.
py2many - Transpiler of Python to many other languages
message-io - Fast and easy-to-use event-driven network library.