What is the best way to practice transformations?

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
  • US-covid

    This Meerschaum plugin scrapes the New York Time for county-level COVID-19 data.

  • One way to practice with transforming data streams is with a project called Meerschaum. To use Pandas for your ETL data streams, create a Meerschaum plugin (a simple Python module in a certain directory) with a fetch() function that returns a DataFrame. Here's an example plugin I wrote to scrape COVID data.

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • Meerschaum

    Create and manage data pipes with Meerschaum.

  • One way to practice with transforming data streams is with a project called Meerschaum. To use Pandas for your ETL data streams, create a Meerschaum plugin (a simple Python module in a certain directory) with a fetch() function that returns a DataFrame. Here's an example plugin I wrote to scrape COVID data.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Found a great new open source ELT Library - any pointers?

    2 projects | /r/dataengineering | 11 Jun 2023
  • I’m struggling with how to ask for help with my task.

    1 project | /r/dataengineering | 26 Mar 2023
  • For those of you who were self taught, what was your path into data engineering

    1 project | /r/dataengineering | 19 Mar 2023
  • Wanted to share my open source incremental ETL framework: Meerschaum

    1 project | /r/dataengineering | 2 Sep 2022
  • Python ETL - Jupyter/Pandas/Postgresql(DW) - Project Structure and Scripting

    1 project | /r/ETL | 23 Jun 2022