Found a great new open source ELT Library - any pointers?

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering
database-connector pipe-data data-engineering Data Analysis Pandas

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • Meerschaum

    Create and manage data pipes with Meerschaum.

    • My company has been using a lot of PySpark, but we're working with not-large data (<1TB/source/day) so Spark can be a bit of overkill sometimes and I've been looking for a light-weight replacement. I think I found a replacement that fits all our needs called Meerschaum but I don't see a lot of other DEs talking about it.

  • mrsm-compose-template

    Bootstrap your Meerschaum Compose project with this template repository.

    • Hi there, Meerschaum author here! Please see this template repository and the plugins page if you'd like to learn more. The Meerschaum Compose workflow is similar to Meltano's but more lightweight and time-series-focused. Please don't let the number of stars discourage you from trying it out!

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • I’m struggling with how to ask for help with my task.

    1 project | /r/dataengineering | 26 Mar 2023

  • For those of you who were self taught, what was your path into data engineering

    1 project | /r/dataengineering | 19 Mar 2023

  • Wanted to share my open source incremental ETL framework: Meerschaum

    1 project | /r/dataengineering | 2 Sep 2022

  • Python ETL - Jupyter/Pandas/Postgresql(DW) - Project Structure and Scripting

    1 project | /r/ETL | 23 Jun 2022

  • Tools that allow you to use scripts to build/maintain data pipeline

    1 project | /r/dataengineering | 16 May 2022