sqlparse
parser
Our great sponsors
sqlparse | parser | |
---|---|---|
7 | 3 | |
3,557 | 1,387 | |
- | 0.5% | |
8.2 | 3.2 | |
1 day ago | 4 months ago | |
Python | Go | |
BSD 3-clause "New" or "Revised" License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sqlparse
-
Show HN: Databasediagram.com – Private, Text to Entity-Relationship Diagram Tool
Suggest checking out the sqlparse library for a way to do the different flavours without needing to address each case directly: https://github.com/andialbrecht/sqlparse
-
Data Load Diagram
Gotcha, since we haven't actually written all of this yet I don't have any useful code snippets to share but we've discussed tackling the problem internally using something like sqlparse. You'd need to identify the relevant sql chunks, parse them for table dependency information and then create the relevant entities in whichever data lineage tool you were using.
-
This Week In Python
sqlparse – A non-validating SQL parser module for Python
-
Open Source SQL Parsers
Regular expressions is a popular approach to extract information from SQL statements. However, regular expressions quickly become too complex to handle common features like WITH, sub-queries, windows clauses, aliases and quotes. sqlparse is a popular python package that uses regular expressions to parse SQL.
-
Automated SQL formatting checks
This one is not bad: https://github.com/andialbrecht/sqlparse.
- Let's write a compiler, part 5: A code generator
parser
-
sqlc: Generating go code from sql statements
For MySQL the situation is a bit different. sqlc uses the parser of TiDB (https://github.com/pingcap/parser), which is a parser that aims to be basically compatible with MySQL, but is quite young and is not a MySQL parser. The most basic queries work, but even simple joins or aggregations usually result in variables with unknown data types or wrong nullability. So you loose a lot of the benefits of sqlc. Manual type annotations for MySQL also do not work most of the time. They are simply ignored and forwarded to MySQL as invalid query if they do not occur on a place where sqlc is expecting them.
-
Wp-SQLite: WordPress running on an SQLite database
This is a disaster waiting to happen. Regular expressions should never be used to parse non-regular languages, of which SQL is one.
There are a variety of mature MySQL dialect parsers available[1][2], and MySQL should have its own public APIs for transforming a query into an AST. Any of those would be a safer and more correct alternative.
-
Open Source SQL Parsers
Pingcap parser is a MySQL parser in Go.
What are some alternatives?
zetasql - ZetaSQL - Analyzer Framework for SQL
pyparsing - Python library for creating PEG parsers [Moved to: https://github.com/pyparsing/pyparsing]
Lark - Lark is a parsing toolkit for Python, built with a focus on ergonomics, performance and modularity.
PLY - Python Lex-Yacc
sqlfluff - A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
JSqlParser - JSqlParser parses an SQL statement and translate it into a hierarchy of Java classes. The generated hierarchy can be navigated using the Visitor Pattern
Pygments
python-user-agents - A Python library that provides an easy way to identify devices like mobile phones, tablets and their capabilities by parsing (browser) user agent strings.
ANTLR - ANTLR (ANother Tool for Language Recognition) is a powerful parser generator for reading, processing, executing, or translating structured text or binary files.
ijson
Python Left-Right Parser - Python Parser
phonenumbers - Python port of Google's libphonenumber