veneur

A distributed, fault-tolerant pipeline for observability data (by stripe)

Veneur Alternatives

Similar projects and alternatives to veneur

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better veneur alternative or higher similarity.

veneur reviews and mentions

Posts with mentions or reviews of veneur. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-08-28.
  • OpenTelemetry in 2023
    36 projects | news.ycombinator.com | 28 Aug 2023
    This was the idea behind Stripe's Veneur project - spans, logs, and metrics all in the same format, "automatically" rolling up cardinality as needed - which I thought was cool but also that it would be very hard to get non-SRE developers on board with when I saw a talk about it a few years ago.

    https://github.com/stripe/veneur

  • Launch HN: Opstrace (YC S19) – open-source Datadog
    11 projects | news.ycombinator.com | 1 Feb 2021
    One pain point with Prometheus is that is has relatively weak support for quantiles, histograms, and sets[1]:

    - Histograms require manually specifying the distribution of your data, which is time-consuming, lossy, and can introduce significant error bands around your quantile estimates.

    - Quantiles calculated via the Prometheus "summary" feature are specific to a given host, and not aggregatable, which is almost never what you want (you normally want to see e.g. the 95th percentile value of request latency for all servers of a given type, or all servers within a region). Quantiles can be calculated from histograms instead, but that requires a well-specified histogram and can be expensive at query time.

    - As far as I know, Prometheus doesn't have any explicit support for unique sets. You can compute this at query time, but persisting and then querying high-cardinality data in this way is expensive.

    Understanding the distribution of your data (rather than just averages) is arguably the most important feature you want from a monitoring dashboard, so the weak support for quantiles is very limiting.

    Veneur[2] addresses these use-cases for applications that use DogStatsD[3] by using clever data structures for approximate histograms[4] and approximate sets[5], but I believe its integration with Prometheus is limited and currently only one-way - there is a CLI app to poll Prometheus metrics and push them into Veneur, but there's no output sink for Veneur to write to Prometheus (or expose metrics for a Prometheus instance to poll).

    It would be extremely useful to have something similar for Prometheus, either by integrating with Veneur or implementing those data structures as an extension to Prometheus.

    [1] https://prometheus.io/docs/practices/histograms/

    [2] https://github.com/stripe/veneur

    [3] https://docs.datadoghq.com/developers/dogstatsd/

    [4] https://github.com/stripe/veneur#approximate-histograms

    [5] https://github.com/stripe/veneur#approximate-sets

Stats

Basic veneur repo stats
2
1,714
3.5
30 days ago

stripe/veneur is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of veneur is Go.

SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com