Secor Alternatives

Similar projects and alternatives to secor

Scio

7 2,524 9.6 Scala secor VS Scio

A Scala API for Apache Beam and Google Cloud Dataflow.
kafkat

1 503 0.0 Ruby secor VS kafkat

KafkaT-ool
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
fluent-plugin-kafka

1 299 4.3 Ruby secor VS fluent-plugin-kafka

Kafka input and output plugin for Fluentd
Apache Kafka

26 27,452 9.9 Java secor VS Apache Kafka

Mirror of Apache Kafka
Thingsboard

17 15,677 10.0 Java secor VS Thingsboard

Open-source IoT Platform - Device management, data collection, processing and visualization.
gcs-connector-for-apache-kafka

1 65 8.3 Java secor VS gcs-connector-for-apache-kafka

Aiven's GCS Sink Connector for Apache Kafka®
graylog

46 7,128 10.0 Java secor VS graylog

Free and open log management
SaaSHub

www.saashub.com featured

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better secor alternative or higher similarity.

Suggest an alternative to secor

secor reviews and mentions

Posts with mentions or reviews of secor. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-11-07.

Kafka to GCS Persistence Tools
2 projects | /r/dataengineering | 7 Nov 2022

secor: Seems a bit on the older side
Storing kakfa messages to dynamoDb
1 project | /r/apachekafka | 11 Feb 2022

Since you are trying to archive this data, a simpler solution is to use something like secor to archive the data in kafka to S3. It’s much cheaper than dynamodb too.
ELT, Data Pipeline
4 projects | dev.to | 1 Jan 2021

Once we had our producer working for Kafka , it was time for a consumer to start pulling data and push it to GCS. With some research over at Github we found Secor from Pinterest to be a viable option for our use. Though it being a great piece of software, it wasn't mapping ideally to our design, for that purpose we had to submit few Pull requests to make the necessary changes to the secor project for our use and the greater good of the open source community. From updating the docs (PR268, PR271, PR277) on how to set it up to adding flexible upload directory structure with hourly support (PR275) and support for partitioned parser with no offset folder (PR279), also added flexible delimited file reader, writer option (PR291) for better control over file structure. Below diagram is our current ELT pipeline running in production.
A note from our sponsor - SaaSHub
www.saashub.com | 9 May 2024

SaaSHub helps you find the best software and product alternatives Learn more →