OOP in python ETL?

• projects

  19 77 4.7 Jupyter Notebook

  Sample projects using Ploomber. (by ploomber)

  

The answer is YES, you can take advantage of OOP best practices to write good ETLs. For instance in this Ploomber sample ETL You can see there's a mix of .sql and .py files, it's within modular components so it's easier to test, deploy and execute. It's way easier than airflow since there's no infra work involved, you only have to setup your pipeline.yaml file. This also allows you to make the code WAY more maintainable and scalable, avoid redundant code and deploy faster :)

• FizzBuzz Enterprise Edition

  329 20,505 0.0 Java

  FizzBuzz Enterprise Edition is a no-nonsense implementation of FizzBuzz made by serious businessmen for serious business purposes.

  

I can write a class for Hello World, and can also write Enterprise level code for FizzBuzz (see: https://github.com/EnterpriseQualityCoding/FizzBuzzEnterpriseEdition).

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project