Kafka-connect-bigquery Alternatives
Similar projects and alternatives to kafka-connect-bigquery
-
Airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
-
debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
realtime
Broadcast, Presence, and Postgres Changes via WebSockets
-
nodejs-bigquery
Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
kafka-connect-bigquery reviews and mentions
-
Evolutionary Data Infrastructure
But is there a way to solve the schema problem? The answer is, yes, through KCBQ.
-
Logical replication and decoding for Cloud SQL for PostgreSQL
Why the Parquet step? You should be able to do straight Debezium -> Kafka -> BQ, using the BQ sink connector for Kafka Connect (https://github.com/confluentinc/kafka-connect-bigquery); we have users using this with the Debezium MySQL connector, I'd expect this to work equally for Postgres.
Disclaimer: working on Debezium
Stats
confluentinc/kafka-connect-bigquery is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of kafka-connect-bigquery is Java.