sqlfluff
A modular SQL linter and auto-formatter with support for multiple dialects and templated code. (by sqlfluff)
Apache Avro
Apache Avro is a data serialization system. (by apache)
| sqlfluff | Apache Avro | |
|---|---|---|
| 35 | 22 | |
| 7,219 | 2,764 | |
| 1.2% | 0.7% | |
| 9.6 | 9.7 | |
| 4 days ago | 7 days ago | |
| Python | Java | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sqlfluff
Posts with mentions or reviews of sqlfluff.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-10-19.
-
🐍🐍 23 issues to grow yourself as an exceptional open-source Python expert 🧑💻 🥇
Repo : https://github.com/sqlfluff/sqlfluff
-
SQL Reserved Words – The Empirical List
I'm surprised sqlfluff hasn't been mentioned yet. Perhaps not a comprehensive list, but it's worked for everything I've thrown at it. There's an ANSI keyword list [0], and then dialect-specific lists for everything from DB2 [1] to Snowflake [2].
[0]: https://github.com/sqlfluff/sqlfluff/blob/main/src/sqlfluff/...
-
Show HN: Postgres Language Server
It has tons of annoying quirks, but I couldn't imagine running a DBT project without it: https://github.com/sqlfluff/sqlfluff
-
Front page news headline scraping data engineering project
Move SQL queries to sql files and read from files (Use sqlfluff to lint the code https://github.com/sqlfluff/sqlfluff)
- Anything like SQLFluff written in Rust?
-
Code autoformatter for SQL in VSCode that plays nicely with dbt
SQLFluff is a good CLI tool for this and includes support for jinja and dbt. I don't think there's a VSCode plugin for it yet.
-
Ask HN: How do you test SQL?
This linter can really enforce some best practices https://github.com/sqlfluff/sqlfluff
A list of best practices:
-
What is something you would learn at college but not a bootcamp (hard skills)
BigQuery SQL and SQLFluff
-
Is the knowledge on how Compilers work applicable to the role of a Data Engineer?
There's a SQL parser/linter called SQLFluff that my team uses for our CI/CD. I've made a few pull requests to fix the parser for the particular SQL dialect we used, and my college compiler classes definitely helped.
-
sqlfluff VS ANTLR - a user suggested alternative
2 projects | 12 Dec 2022
Apache Avro
Posts with mentions or reviews of Apache Avro.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-01-14.
-
Open Table Formats Such as Apache Iceberg Are Inevitable for Analytical Data
Apache AVRO [1] is one but it has been largely replaced by Parquet [2] which is a hybrid row/columnar format
[1] https://avro.apache.org/
-
Generating Avro Schemas from Go types
The most common format for describing schema in this scenario is Apache Avro.
-
How do you update an existing avro schema using apache avro SchemaBuilder?
I am testing a new schema registry which loads and retrieves different kinds of avro schemas. In the process of testing, I need to create a bunch of different types of avro schemas. As it involves a lot of permutations, I decided to create the schema programmatically.I am using the apache avro SchemaBuilder to do so.
- The state of Apache Avro in Rust
- How people generate examples for multiple programming languages?
-
gRPC on the client side
Other serialization alternatives have a schema validation option: e.g., Avro, Kryo and Protocol Buffers. Interestingly enough, gRPC uses Protobuf to offer RPC across distributed components:
-
Understanding Azure Event Hubs Capture
Apache Avro is a data serialization system, for more information visit Apache Avro
-
tl;dr of Data Contracts
Once things like JSON became more popular Apache Avro appeared. You can define Avro files which can then be generated into Python, Java C, Ruby, etc.. classes.
-
In One Minute : Hadoop
Avro, a data serialization system based on JSON schemas.
-
Events: Fat or Thin?
Supporting multiple versions of an event schema is a solved problem. Apache Avro with a published schema hash in a message header is one solution.
https://avro.apache.org/
What are some alternatives?
When comparing sqlfluff and Apache Avro you can also consider the following projects:
vscode-sqlfluff - An extension to use the sqlfluff linter in vscode.
Protobuf - Protocol Buffers - Google's data interchange format
sqlparse - A non-validating SQL parser module for Python
SBE - Simple Binary Encoding (SBE) - High Performance Message Codec
dbt-utils - Utility functions for dbt projects.
Apache Thrift - Apache Thrift
ale - Check syntax in Vim/Neovim asynchronously and fix files, with Language Server Protocol (LSP) support
iceberg - Apache Iceberg
soda-sql - Data profiling, testing, and monitoring for SQL accessible data.
Apache Parquet - Apache Parquet
Metabase - The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:
gRPC - The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)