parseable
qryn
parseable | qryn | |
---|---|---|
26 | 10 | |
1,705 | 947 | |
2.4% | 3.7% | |
9.2 | 9.6 | |
7 days ago | 7 days ago | |
Rust | JavaScript | |
GNU Affero General Public License v3.0 | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parseable
-
New release of Parseable [Log analytics system written in Rust] is now available
Checkout the release here: https://github.com/parseablehq/parseable/releases/tag/v0.7.0
-
OpenObserve: Elasticsearch/Datadog alternative in Rust.. 140x lower storage cost
How does this compare to Parseable?
https://github.com/parseablehq/parseable
First guess is that the underlying storage / query layer is pretty similar (Parquet + Datafusion), but OpenObserve has more built in use cases?
As an aside, it’s awesome that Datafusion’s existence and maturity makes launching a product with scalable analytical reads 10x easier than before and cool to see so many projects integrating it
-
Infino - Fast and scalable service to store time series and logs - written in Rust
Another cool rust project in this space for logs: https://github.com/parseablehq/parseable. Using Arrow for the memory format makes life easier for incorporating with other tools like Grafana.
- Lightweight ELK alternative for ingesting and analyzing local logs?
-
I can't recommend serious use of an all-in-one local Grafana Loki setup
- Visualize with Grafana
https://github.com/parseablehq/parseable
(founder here)
-
Parseable - an open source log observability platform
Hello DevOps community, we've been working on https://github.com/parseablehq/parseable for a while now. Would love to get any feedback, questions etc.
- Parseable – unify log data to Parquet on S3
- Show HN: Columnar store for fast, lightweight logging
- Lightweight, high performance logging engine based on Apache Arrow & Parquet
-
Syslog server
Maybe also take a look at: https://github.com/parseablehq/parseable
qryn
- Show HN: Pyroscope/Phlare drop-in compatible replacement with OLAP storage
-
Coinbase (?) had a $65M Datadog bill per Datadog's Q1 earnings call
Thanks for mentioning qryn! We are a non-corporate alternative and feature full ingestion compatibility with DataDog (including Cloudflare emitters, etc), Loki, Prometheus, Tempo, Elastic & others for both on-prem (https://qryn.dev) and Cloud (https://qryn.cloud) deployments, without the killer price tag.
Note: in qryn s3/r2 are as close to /dev/null as it gets!
-
What I like using Grafana Loki for (and where I avoid it)
qryn and vector get along very well! We use it all the time for testing and developing qryn and qryn.cloud and most of our users love it! But we're just as compatible with Loki/LogQL, Influx protocol for metrics and logs, Elastic Bulk, Prometheus for metrics, opentelemetry for everything... and more coming!
Feel free to open an issue on our repository if you end up trying it and/or would like us to help out!
https://qryn.dev
- Making a Homegrown ClickHouse Log for $20/mo
-
Building the world’s fastest website analytics (2021)
> *it would be nice to use ClickHouse as a Prometheus backend*
Well... that's already possible and it works great! As you might know https://qryn.dev turns ClickHouse into a powerful Prometheus *remote_write* backend and the GO/cloud version supports full PromQL queries off ClickHouse transparently (the JS/Node version transpiles to LogQL instead) and from a performance point of view its well on par with Prometheus, Mimir and Victoriametrics in our internal benchmarks (including Clickhouse as part of the resource set) with millions of inserts/s and broad client compatibility. Same for Logs (LogQL) and Traces (Tempo)
Disclaimer: I work on qryn
-
Think Prometheus, but for logs (not metrics). Simple, efficient, fast log store
Thanks for mentioning our project! qryn (formerly cloki) is currently more focused on the polyglot factor and trying to unify logs, metrics and telemetry on a single stateless platform, easy to scale without hundreds of services and moving parts. At this stage, its a lightweight Grafana Cloud alternative just requiring clickhouse - no sidecar databases, redis, or plugins needed, and no new query languages or rules to learn. Latest info is at https://qryn.dev
-
Show HN: Distributed Tracing Using OpenTelemetry and ClickHouse
cloki can be used to read metrics out of any CH table so it should work fine.
we also just introduced experimental support for ingesting OTLP/ZIPKIN spans and a tempo-compatible API in cloki, looking for testers to validate this feature:
https://github.com/lmangani/cLoki/wiki/Tempo-Tracing#clickho...
Internally trace spans are stored as tagged JSON logs, meaning they are available from both Loki and Tempo APIs and can be used from pretty much any visualization, too!
-
I Don't Think Elasticsearch Is a Good Logging System
There's also cLoki. It's a new project that puts a Loki gateway over a ClickHouse backend store. We're looking at it and plan a presentation from the author(s) at the next ClickHouse SF Bay Area Meetup.
https://github.com/lmangani/cLoki
What are some alternatives?
loki - Like Prometheus, but for logs.
zeek-clickhouse
openobserve - 🚀 10x easier, 🚀 140x lower storage cost, 🚀 high performance, 🚀 petabyte scale - Elasticsearch/Splunk/Datadog alternative for 🚀 (logs, metrics, traces, RUM, Error tracking, Session replay).
uptrace - Open source APM: OpenTelemetry traces, metrics, and logs
clp - Compressed Log Processor (CLP) is a free tool capable of compressing text logs and searching the compressed logs without decompression.
vector - A high-performance observability data pipeline.
kube-ns-suspender - A k8s controller that scales up and down namespaces on-demand with an embedded friendly UI and a Prometheus exporter. Inspired by kube-downscaler.
signoz - SigNoz is an open-source observability platform native to OpenTelemetry with logs, traces and metrics in a single application. An open-source alternative to DataDog, NewRelic, etc. 🔥 🖥. 👉 Open source Application Performance Monitoring (APM) & Observability tool
pino - 🌲 super fast, all natural json logger
ClickHouse - ClickHouse® is a free analytics DBMS for big data
tracing - Application level tracing for Rust.
syslog-ng - syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.