plugin-sdk
transfer
| plugin-sdk | transfer | |
|---|---|---|
| 1 | 7 | |
| 20 | 540 | |
| - | 3.5% | |
| 9.7 | 9.6 | |
| about 2 hours ago | 3 days ago | |
| Go | Go | |
| Mozilla Public License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
plugin-sdk
-
Building a High Performance Data Integration Framework in Go
Great question! We specifically started with connectors/plugins to cloud infrastructure providers and other infrastructure vendors - This is why most of our users migrated and/or compared us to the tools specified here (https://www.cloudquery.io/docs/cq-vs-others/overview).
There are no connectors for AWS, GCP, Azure in FiveTran, Airbyte, Meltano but as we extend the number of our source plugins I believe this question will come up more and we will add those products as well to our comparison list.
The protocol is just standard/plain gRPC (https://www.cloudquery.io/docs/developers/architecture). Protobuf is defined here - https://github.com/cloudquery/plugin-sdk/tree/main/internal/...
Basically just the normalized, verified data + metadata, types
transfer
- Migrate mongodb Datawarehouse to snowflake
- Preventing replication slot overflow on Postgres DB (AWS RDS)
- Preventing WAL Growth on Postgres DB Running on AWS RDS
-
Launch HN: Artie (YC S23) – Real time data replication to data warehouses
Hi! Yes, our next 2 connectors are going to be S3 and DynamoDB.
GitHub Issue: https://github.com/artie-labs/transfer/issues/157
If you'd like to be another design partner for us on this, do reach out. I'm at [email protected].
- Artie Transfer: Real time data replication from transactional databases to Snowflake
- Artie Transfer: Fast data replication between your database and data warehouse
What are some alternatives?
peerdb - Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Dataplane - Dataplane is a data platform that makes it easy to construct a data mesh with automated data pipelines and workflows.
universal-data - Lightweight ELT/ETL that's perfect for api data extraction and transformation.
pgcapture - A scalable Netflix DBLog implementation for PostgreSQL
TI84-Wordle - Wordle for the TI84 Plus CE graphing calculator.
openmtp - OpenMTP - Advanced Android File Transfer Application for macOS
incubator-devlake - Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
airbyte - The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
debezium-design-documents
cesium - A GUI shell for the TI-84+CE