athenaSQL Alternatives
Similar projects and alternatives to athenaSQL
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
-
-
-
data-engineer-handbook
This is a repo with links to everything you'd ever want to learn about data engineering
athenaSQL discussion
athenaSQL reviews and mentions
-
AthenaSQL: SQL query builder for AWS Athena, inspired by pySpark SQL
Hi Everyone,
I work in adtech, where we handle massive log-level data. To cut costs and improve performance for ML and optimization, my team and I chose a lakehouse approach using AWS (S3 + OTFs / partitioned Parquet + Athena + Glue).
One challenge we faced with this data stack was managing Athena queries in our ETL jobs. Since Athena handles much of our data-heavy processing, we ended up storing hundreds of lines of query code as strings in Python scripts, which quickly became a nightmare to maintain.
We needed something similar to PySpark SQL that could output SQL string compatible with Athena. So we built athenaSQL. It mimics the PySpark SQL API, providing a familiar interface and outputting SQL queries directly.
It is far from complete at the moment but it has most of the basic query statements. I would love it if you could test it out and share any feedback! I hope someone is in need of such a tool, if it lacks the functionality you are seeking, let’s build it together! And feel free to critique it as much as you like. :)
github: https://github.com/nabilseid/athenaSQL
docs: github.com/nabilseid/athenaSQL
Stats
nabilseid/athenaSQL is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of athenaSQL is Python.
Popular Comparisons
Sponsored