pg_parse
sqlparse
Our great sponsors
pg_parse | sqlparse | |
---|---|---|
1 | 7 | |
67 | 3,581 | |
- | - | |
3.9 | 8.2 | |
3 months ago | 8 days ago | |
Rust | Python | |
MIT License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pg_parse
-
Open Source SQL Parsers
Rust: pg_query.rs
sqlparse
-
Show HN: Databasediagram.com – Private, Text to Entity-Relationship Diagram Tool
Suggest checking out the sqlparse library for a way to do the different flavours without needing to address each case directly: https://github.com/andialbrecht/sqlparse
-
Data Load Diagram
Gotcha, since we haven't actually written all of this yet I don't have any useful code snippets to share but we've discussed tackling the problem internally using something like sqlparse. You'd need to identify the relevant sql chunks, parse them for table dependency information and then create the relevant entities in whichever data lineage tool you were using.
-
This Week In Python
sqlparse – A non-validating SQL parser module for Python
-
Open Source SQL Parsers
Regular expressions is a popular approach to extract information from SQL statements. However, regular expressions quickly become too complex to handle common features like WITH, sub-queries, windows clauses, aliases and quotes. sqlparse is a popular python package that uses regular expressions to parse SQL.
-
Automated SQL formatting checks
This one is not bad: https://github.com/andialbrecht/sqlparse.
- Let's write a compiler, part 5: A code generator
-
BigQuery Lineage
We used this repo for this: https://github.com/andialbrecht/sqlparse. I may have miscommunicated. We didn't write the parser from scratch, we created a way for the parser to detect downstream and upstream dependencies of the resource.
What are some alternatives?
libpg_query - C library for accessing the PostgreSQL parser outside of the server environment
zetasql - ZetaSQL - Analyzer Framework for SQL
pg_query_go - Go library to parse and normalize SQL queries using the PostgreSQL query parser
pyparsing - Python library for creating PEG parsers [Moved to: https://github.com/pyparsing/pyparsing]
pg_query - Ruby extension to parse, deparse and normalize SQL queries using the PostgreSQL query parser
Lark - Lark is a parsing toolkit for Python, built with a focus on ergonomics, performance and modularity.
pglast - PostgreSQL Languages AST and statements prettifier: master branch covers PG10, v2 branch covers PG12, v3 covers PG13, v4 covers PG14, v5 covers PG15, v6 covers PG16
PLY - Python Lex-Yacc
sqlfluff - A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
Apache Hive - Apache Hive
Pygments