Strategies have you used to sync a PostgreSQL database with Redshift?

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering
Analytics change-data-capture Golang kafka-connect Go

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • pipelinewise

    Data Pipeline Framework using the singer.io spec

    • https://github.com/transferwise/pipelinewise <- Based on Singer, supported by Transferwise (now just Wise). Again an open source solution

  • Rudderstack

    Privacy and Security focused Segment-alternative, in Golang and React

    • https://www.rudderstack.com <- Another great solution that can offer all the different types of pipelines you might need under one platform. Probably the best but I have to make a disclaimer here that I work there :)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • debezium

    Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

    • https://debezium.io/ <- The main CDC framework out there, in case you feel adventurous and want to implement it yourself. Main issue I find with it, very tightly integrated to the Kafka ecosystem.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • How to replicate data from MongoDB into Clickhouse?

    2 projects | /r/Clickhouse | 11 Dec 2021

  • Show HN: Shareable Analytics for public stats. Customize sections and themes

    1 project | news.ycombinator.com | 11 Mar 2024

  • GoatCounter creator is hoping to raise at least €1k for basic living expense

    3 projects | news.ycombinator.com | 13 Jan 2024

  • Goatcounter: Easy web analytics. No tracking of personal data

    1 project | news.ycombinator.com | 15 Dec 2023

  • What has your personal website/blog done for you?

    1 project | news.ycombinator.com | 3 Sep 2023