Where to store high-cardinality metrics?

This page summarizes the projects mentioned and recommended in the original post on /r/sre
Prometheus Search Observability Kubernetes ElasticSearch

WorkOS
Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • signoz

    SigNoz is an open-source observability platform native to OpenTelemetry with logs, traces and metrics in a single application. An open-source alternative to DataDog, NewRelic, etc. 🔥 🖥. 👉 Open source Application Performance Monitoring (APM) & Observability tool

    You should try filtering and aggregating span data directly. A columnar store with the right indexes should provide blazing-fast queries. We are building SigNoz and chose ClickHouse due to high-cardinality filtering and faster aggregates with fast ingestion. Honeycomb should also perform fast due to similar reasons.

  • Elasticsearch

    Free and Open, Distributed, RESTful Search Engine

    Elasticsearch. The storage overhead has been significantly improved with their new TSDB work: https://github.com/elastic/elasticsearch/issues/74660

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • cortex

    A horizontally scalable, highly available, multi-tenant, long term Prometheus. (by cortexproject)

    Cortex is not really good for high-cardinality metrics (if you are talking about https://github.com/cortexproject/cortex)

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts