parseable
logs-benchmark
| parseable | logs-benchmark | |
|---|---|---|
| 26 | 11 | |
| 1,713 | 75 | |
| 2.4% | - | |
| 9.2 | 10.0 | |
| about 12 hours ago | over 1 year ago | |
| Rust | Shell | |
| GNU Affero General Public License v3.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parseable
-
New release of Parseable [Log analytics system written in Rust] is now available
Checkout the release here: https://github.com/parseablehq/parseable/releases/tag/v0.7.0
-
OpenObserve: Elasticsearch/Datadog alternative in Rust.. 140x lower storage cost
How does this compare to Parseable?
https://github.com/parseablehq/parseable
First guess is that the underlying storage / query layer is pretty similar (Parquet + Datafusion), but OpenObserve has more built in use cases?
As an aside, it’s awesome that Datafusion’s existence and maturity makes launching a product with scalable analytical reads 10x easier than before and cool to see so many projects integrating it
-
Infino - Fast and scalable service to store time series and logs - written in Rust
Another cool rust project in this space for logs: https://github.com/parseablehq/parseable. Using Arrow for the memory format makes life easier for incorporating with other tools like Grafana.
- Lightweight ELK alternative for ingesting and analyzing local logs?
-
I can't recommend serious use of an all-in-one local Grafana Loki setup
- Visualize with Grafana
https://github.com/parseablehq/parseable
(founder here)
-
Parseable - an open source log observability platform
Hello DevOps community, we've been working on https://github.com/parseablehq/parseable for a while now. Would love to get any feedback, questions etc.
- Parseable – unify log data to Parquet on S3
- Show HN: Columnar store for fast, lightweight logging
- Lightweight, high performance logging engine based on Apache Arrow & Parquet
-
Syslog server
Maybe also take a look at: https://github.com/parseablehq/parseable
logs-benchmark
-
OpenObserve: Elasticsearch/Datadog alternative in Rust.. 140x lower storage cost
I am a maintainer at SigNoz. Nice to see OpenObserve's belief that the future of Observability should be OpenSource. We chose clickhouse rather than building a database as it takes multi-year effort to move a db to maturity and clickhouse has been battle-tested at Yandex, Uber and Cloudflare. Clickhouse also provides native integration with s3 and other blob storages. Our users have been using disk as hot storage for a week and moving the data to s3 after that. Tiered storage is really cool in terms of query performance.
We have also seen logs data of our users at a compression ratio of 30x/40x. We have published a logs benchmark (https://github.com/SigNoz/logs-benchmark) where the data is very high-cardinal (causing a compression factor of only 2.5x). Would love to see how does OpenObserve perform in that dataset someday.
Wishing you best for the journey ahead.
-
Elastic vs Loki vs SigNoz : A Performance Benchmark of self hosted & open source logging platforms
Did you update the benchmark after you got feedback from this user at Hacker News or after you got the feedback that including Loki here is kinda pointless?
- Elastic vs Loki vs SigNoz : A Perf Benchmark of open source logging platforms
- FLiP Stack Weekly 28 Jan 2023
- FLiP Stack Weekly 28-Jan-2023
- Elastic, Loki and SigNoz – A Perf Benchmark of Open-Source Logging Platforms
What are some alternatives?
loki - Like Prometheus, but for logs.
opentelemetry-collector-co
openobserve - 🚀 10x easier, 🚀 140x lower storage cost, 🚀 high performance, 🚀 petabyte scale - Elasticsearch/Splunk/Datadog alternative for 🚀 (logs, metrics, traces, RUM, Error tracking, Session replay).
clp - Compressed Log Processor (CLP) is a free tool capable of compressing text logs and searching the compressed logs without decompression.
carbonyl - Chromium running inside your terminal
kube-ns-suspender - A k8s controller that scales up and down namespaces on-demand with an embedded friendly UI and a Prometheus exporter. Inspired by kube-downscaler.
shite - The little hot-reloadin' static site maker from shell.
qryn - qryn is a polyglot, high-performance observability framework for ClickHouse. Ingest, store and analyze logs, metrics and telemetry traces from any agent supporting Loki, Prometheus, OTLP, Tempo, Elastic, InfluxDB and many more formats and query transparently using Grafana or any other compatible client.
clamshell - experimenting with a python based shell
pino - 🌲 super fast, all natural json logger
FLiPN-Py-Stocks - finnhub stocks