Logstash
pipelinewise
Our great sponsors
| Logstash | pipelinewise | |
|---|---|---|
| 5 | 5 | |
| 13,999 | 604 | |
| 0.6% | 1.0% | |
| 9.6 | 6.1 | |
| 7 days ago | 22 days ago | |
| Java | Python | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Logstash
-
Simple way to centralize my server logs?
There are probably too many to chose from. Logstash, Promtail, Vector, Filebeat, FluentD, Logagent and probably many more
-
Help with parsing log in logstash into uniqe lines
https://github.com/elastic/logstash/issues/1650 See if this works.
-
Looking for open source projects that use data pipelines and big data flows
Is logstash the kind of project you are looking for? https://github.com/elastic/logstash
-
Top Observability tools for DevOps Engineers and SREs
Logstash is completely free and the source code is available freely on GitHub.
-
Disable Console Output in Logstash 7.10
What log level are you set to in logstash.yml? The default log level is "info" which is pretty chatty. I set mine to "error". See https://github.com/elastic/logstash/blob/master/config/logstash.yml#L248.
pipelinewise
-
How does your organization run ETL?
Pipelinewise from PSQL to Snowflake running in AWS EC2 K8s.
-
Strategies have you used to sync a PostgreSQL database with Redshift?
https://github.com/transferwise/pipelinewise <- Based on Singer, supported by Transferwise (now just Wise). Again an open source solution
- Looking for open source projects that use data pipelines and big data flows
-
How to migrate from MariaDB to Postgres?
Not tested by myself, but could work: https://github.com/transferwise/pipelinewise
- MySQL 5.6 -> postgres 13 ?
What are some alternatives?
Logback - The reliable, generic, fast and flexible logging framework for Java.
meltano
Apache Log4j 2 - Apache Log4j 2 is a versatile, feature-rich, efficient logging API and backend for Java.
meltano - Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
nifi - Apache NiFi
debezium - Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
graylog - Free and open log management
electricitymaps-contrib - A real-time visualisation of the CO2 emissions of electricity consumption
Flume - Mirror of Apache Flume
jet-train
Logbook - An extensible Java library for HTTP request and response logging
Rudderstack - Privacy and Security focused Segment-alternative, in Golang and React