Personal Project Guidance

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • meltano

    I would use something like meltano or airbyte, but if you really want to use Lambda for extraction I'd say there is no point spinning up a Redshift cluster just for that, Athena would be the way to go and you can use dbt pretty nicely with it and it would keep costs down.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • airbyte

    The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

    I would use something like meltano or airbyte, but if you really want to use Lambda for extraction I'd say there is no point spinning up a Redshift cluster just for that, Athena would be the way to go and you can use dbt pretty nicely with it and it would keep costs down.

  • dbt-athena

    The athena adapter plugin for dbt (https://getdbt.com)

    I would use something like meltano or airbyte, but if you really want to use Lambda for extraction I'd say there is no point spinning up a Redshift cluster just for that, Athena would be the way to go and you can use dbt pretty nicely with it and it would keep costs down.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Two-way syncs across your data stack and SaaS tools

    1 project | news.ycombinator.com | 24 Jan 2023
  • Continuously import Aurora MySQL data into BigQuery

    1 project | /r/dataengineering | 3 Jan 2023
  • How to Access Application Folder on EKS Cluster?

    1 project | /r/kubernetes | 22 Dec 2022
  • Any project with well-written API Extractor/connector classes in Python?

    1 project | /r/dataengineering | 22 Dec 2022
  • Fivetran is the best ETL tool out there

    1 project | /r/dataengineering | 16 Dec 2022

Did you konow that Java is
the 8th most popular programming language
based on number of metions?