F2-Data-Pipeline Alternatives

Similar projects and alternatives to F2-Data-Pipeline

• ethereum-etl-airflow

  7 387 9.0 Python F2-Data-Pipeline VS ethereum-etl-airflow

  Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

  

• covid-19-data-engineering-pipeline

  1 22 5.3 Python F2-Data-Pipeline VS covid-19-data-engineering-pipeline

  A Covid-19 data pipeline on AWS featuring PySpark/Glue, Docker, Great Expectations, Airflow, and Redshift, templated in CloudFormation and CDK, deployable via Github Actions.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Mage

  77 7,001 9.9 Python F2-Data-Pipeline VS Mage

  🧙 The modern replacement for Airflow. Mage is an open-source data pipeline tool for transforming and integrating data. https://github.com/mage-ai/mage-ai

  

• data_check

  1 4 8.3 Python F2-Data-Pipeline VS data_check

  data and pipeline testing with and for SQL

• great_expectations

  15 9,466 9.9 Python F2-Data-Pipeline VS great_expectations

  Always know what to expect from your data.

  

• Prefect

  19 14,586 10.0 Python F2-Data-Pipeline VS Prefect

  The easiest way to build, run, and monitor data pipelines at scale.

  

• airbyte

  139 13,923 10.0 Python F2-Data-Pipeline VS airbyte

  The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.