Top 4 Python etl-framework Projects

quokka

23 1,081 8.3 Python

Making data lake work for time series (by marsupialtail)

Project mention: How Query Engines Work | news.ycombinator.com | 2023-09-08

An awesome read!
Something related that I found out about from HN a few months back is another engine called quokka. It's particularly interesting and applicable how quokka schedules distributed queries to outperform Spark https://github.com/marsupialtail/quokka/blob/master/blog/why...

dataall

1 210 9.4 Python

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
patterns-devkit

5 106 2.9 Python

Data pipelines from re-usable components
flowrunner

3 8 5.9 Python

Flowrunner is a lightweight package to organize and represent Data Engineering/Science workflows

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).