connectors

Connectors for capturing data from external data sources (by estuary)

Connectors Alternatives

Similar projects and alternatives to connectors

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better connectors alternative or higher similarity.

connectors reviews and mentions

Posts with mentions or reviews of connectors. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-09-22.
  • All the ways to capture changes in Postgres
    12 projects | news.ycombinator.com | 22 Sep 2023
    No. We implemented our own [1] for a few reasons:

    * Scaling well to multi-TB DBs without pinning the write-ahead log (potentially filling your DB's disk) while the backfill is happening. Instead, our connector constantly reads the WAL and works well in setups like Supabase that have very restrictive WAL sizes (1GB iirc).

    * Incremental fault-tolerant backfills that can be stopped and resumed at will.

    * Being able to offer "precise" captures which are logically consistent in terms of the sequence of create/update/delete events.

    The last one becomes really interesting when paired with REPLICA IDENTITY FULL, because you can feed it into an incremental computation (perhaps differential dataflow) for streaming updates of a continuous computation.

    Our work is based off of the Netflix DBLog paper, which we took and ran with.

    [1] https://github.com/estuary/connectors/tree/main/source-postg...

  • Why would you ever not use CDC for ELT?
    1 project | /r/dataengineering | 7 May 2023
    Our connectors themselves are fully OSS (for example, here's PostgreSQL)
  • What Is Dbt and Why Are Companies Using It?
    3 projects | news.ycombinator.com | 2 Dec 2021
    We've used https://github.com/estuary/connectors/pkgs/container/source-... to load data sets in the many terabytes. Caveat that, while it's implemented to Airbyte's spec, we've only used it with Flow.
  • A note from our sponsor - WorkOS
    workos.com | 28 Apr 2024
    The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Stats

Basic connectors repo stats
3
32
9.9
1 day ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com