All you need is Wide Events, not "Metrics, Logs and Traces"

• BitSwan

  1 1 9.4 Python
  

At the company I work for we send json to kafka and subsiquently to Elastic search with great effect. That's basically 'wide events'. The magical thing about hooking up a bunch of pipelines with kafka is that all of a sudden your observability/metrics system becomes an amazing API for extending systems with aditional automations. Want to do something when a router connects to a network? Just subscribe to this kafka topic here. It doesn't matter that the topic was origionally intended just to log some events. We even created an open source library for writing and running these,pipelines in jupyter. Here's a super simple example https://github.com/bitswan-space/BitSwan/blob/master/example...

People tend to think kafka is hard, but as you can see from the example, it can be extremely easy.

• community

  7 693 9.0 Python

  OpenTelemetry community content (by open-telemetry)

  

otel is working on their events spec https://github.com/open-telemetry/community/issues/1688

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• coroot

  33 3,510 9.1 Go

  Coroot is an open-source APM & Observability tool, a DataDog and NewRelic alternative 📊, 🖥️, 👉. Powered by eBPF for rapid insights into system performance. Monitor, analyze, and optimize your infrastructure effortlessly for peak reliability at any scale.

  

I think ClickHouse is becoming a default storage for observability nowdays: https://clickhouse.com/use-cases/logging-and-metrics

And there are quite a few solutions on top of it.

A couple of examples that seem to be interesting (however I didn't use them in real life):

https://coroot.com/

• VictoriaMetrics

  97 10,826 9.9 Go

  VictoriaMetrics: fast, cost-effective monitoring solution and time series database

  

• opentelemetry-collector-contrib

  43 2,546 10.0 Go

  Contrib repository for the OpenTelemetry Collector

  

The open telemetry collector does just that. https://github.com/open-telemetry/opentelemetry-collector-co...

• opentelemetry-collector-co

  10 - -

The open telemetry collector does just that. https://github.com/open-telemetry/opentelemetry-collector-co...

• slog-parquet

  1 9 6.8 Go

  🚨 slog: Parquet handler + Object Storage

There seems to be somebody trying to do the second idea for Go's slog package: https://github.com/samber/slog-parquet

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project