Observability

Open-source projects categorized as Observability
Edit details
Language: + Go + TypeScript + C + Java + Rust + Python + JavaScript + Dockerfile + C++
Topics: Monitoring Metrics Prometheus Kubernetes Opentelemetry
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Sponsored

Top 23 Observability Open-Source Projects

  • Netdata

    The open-source observability platform everyone needs

    • Project mention: A list of SaaS, PaaS and IaaS offerings that have free tiers of interest to devops and infradev | dev.to | 2024-02-05

    netdata.cloud — Netdata is an open-source tool to collect real-time metrics. It's a growing product and can also be found on GitHub!

  • skywalking

    APM, Application Performance Monitoring System

    • Project mention: Show HN: OneUptime – open-source Datadog Alternative | news.ycombinator.com | 2024-04-02

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • jaeger

    CNCF Jaeger, a Distributed Tracing Platform

    • Project mention: Observability with OpenTelemetry, Jaeger and Rails | dev.to | 2024-02-22

    Jaeger maps the flow of requests and data as they traverse a distributed system. These requests may make calls to multiple services, which may introduce their own delays or errors. https://www.jaegertracing.io/

  • kibana

    Your window into the Elastic Stack

    • Project mention: Fighting the Good Fight: Change the Default Kibana Theme to Dark Mode | /r/elasticsearch | 2023-12-05

  • cilium

    eBPF-based Networking, Security, and Observability

    • Project mention: Cisco to Acquire Cloud Native Networking and Security Leader Isovalent | news.ycombinator.com | 2023-12-21

    They would have had to add a few externals to get to Graduated but it's definitely a minority:

    https://github.com/cilium/cilium/blob/main/MAINTAINERS.md

  • signoz

    SigNoz is an open-source observability platform native to OpenTelemetry with logs, traces and metrics in a single application. An open-source alternative to DataDog, NewRelic, etc. 🔥 🖥. 👉 Open source Application Performance Monitoring (APM) & Observability tool

    • Project mention: Show HN: OneUptime – open-source Datadog Alternative | news.ycombinator.com | 2024-04-02

    You should also check out SigNoz [1], we are an open-core alternative to DataDog - based natively on OpenTelemetry. We also have a cloud product if you don't want to host yourself

    [1] https://signoz.io

  • zipkin

    Zipkin is a distributed tracing system

    • Project mention: Enhancing API Observability Series (Part 3): Tracing | dev.to | 2024-03-19

    When choosing distributed tracing tools, considerations include your technology stack, business requirements, and monitoring complexity. Zipkin, SkyWalking, and OpenTelemetry are popular distributed tracing solutions, each with its unique features.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • vector

    A high-performance observability data pipeline.

    • Project mention: Docker Log Observability: Analyzing Container Logs in HashiCorp Nomad with Vector, Loki, and Grafana | dev.to | 2024-04-19

    job "vector" { datacenters = ["dc1"] # system job, runs on all nodes type = "system" group "vector" { count = 1 network { port "api" { to = 8686 } } ephemeral_disk { size = 500 sticky = true } task "vector" { driver = "docker" config { image = "timberio/vector:0.30.0-debian" ports = ["api"] volumes = ["/var/run/docker.sock:/var/run/docker.sock"] } env { VECTOR_CONFIG = "local/vector.toml" VECTOR_REQUIRE_HEALTHY = "false" } resources { cpu = 100 # 100 MHz memory = 100 # 100MB } # template with Vector's configuration template { destination = "local/vector.toml" change_mode = "signal" change_signal = "SIGHUP" # overriding the delimiters to [[ ]] to avoid conflicts with Vector's native templating, which also uses {{ }} left_delimiter = "[[" right_delimiter = "]]" data=<

  • Prefect

    The easiest way to build, run, and monitor data pipelines at scale.

    • Project mention: Prefect: A workflow orchestration tool for data pipelines | news.ycombinator.com | 2024-03-13

  • kubesphere

    The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️

    • Project mention: KubeSphere – K8s platform tailored for hybrid multicloud | news.ycombinator.com | 2024-01-01

  • thanos

    Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

    • Project mention: Looking for a way to remote in to K's of raspberry pi's... | /r/sysadmin | 2023-12-10

    Monitoring = netdata on each RPi https://www.netdata.cloud/ binded to the vpn interface being scraped into a prometeus thaons https://thanos.io/ setup with grafana to give management the Green all is good screens (very important).

  • VictoriaMetrics

    VictoriaMetrics: fast, cost-effective monitoring solution and time series database

    • Project mention: OpenTelemetry Is Too Complicated | news.ycombinator.com | 2024-04-03

    VictoriaMetrics CTO here.

    The referred library is the official OpenTelemetry package for reading metrics in Go language [1] - more details are available at [2].

    Note that we at VictoriaMetrics like the idea of unified observability standard like OpenTelemetry. The issue is in the current otel implementation. It is too bloated and very inefficient. This contradicts to our experience with observability cases, which need very optimized format for metrics' transfer in order to reduce costs on CPU and network traffic needed to transfer and process these metrics.

    VictoriaMetrics continues investing in OpenTelemetry by providing integration docs [3] and improving the existing functionality for otel metrics' ingestion [4].

    [1] https://github.com/open-telemetry/opentelemetry-proto-go

    [2] https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2570...

    [3] https://docs.victoriametrics.com/guides/getting-started-with...

    [4] https://github.com/VictoriaMetrics/VictoriaMetrics/issues/60...

  • kubeshark

    The API traffic analyzer for Kubernetes providing real-time K8s protocol-level visibility, capturing and monitoring all traffic and payloads going in, out and across containers, pods, nodes and clusters. Inspired by Wireshark, purposely built for Kubernetes

    • Project mention: Show HN: Alaz: Open-Source, Self-Hosted, eBPF-Based K8s Monitoring | news.ycombinator.com | 2023-09-06

    The one similar product I had come across is Kubeshark (https://github.com/kubeshark/kubeshark). But admittedly the eBPF way seems more performant theoretically (given you can afford to have a modern-enough kernel). I'm really excited to see how this project develops out.

    The eBPF-mode of innovation is pretty exciting, truly a fresh lens to building software. I'm also following Akita Software - the company building an eBPF paradigm of monitoring.

  • pyroscope

    Continuous Profiling Platform. Debug performance issues down to a single line of code

    • Project mention: Grafana Pyroscope v1.0.0 Release | news.ycombinator.com | 2023-08-29

  • openobserve

    🚀 10x easier, 🚀 140x lower storage cost, 🚀 high performance, 🚀 petabyte scale - Elasticsearch/Splunk/Datadog alternative for 🚀 (logs, metrics, traces, RUM, Error tracking, Session replay).

    • Project mention: Show HN: OneUptime – open-source Datadog Alternative | news.ycombinator.com | 2024-04-02

    Lot of interesting OSS observability products coming out in recent years. One of the more impressive(and curious for many reasons) IMHO is OpenObserve: https://github.com/openobserve/openobserve .

    As opposed to just a stack, they are implementing just about the whole backend shebang from scratch.

  • howtheysre

    A curated collection of publicly available resources on how technology and tech-savvy organizations around the world practice Site Reliability Engineering (SRE)

    • Project mention: 5 GitHub Projects to Help You Become a Better DevOps Engineer ⚡ | dev.to | 2023-06-23

    1. How they SRE

  • nightingale

    An all-in-one observability solution which aims to combine the advantages of Prometheus and Grafana. It manages alert rules and visualizes metrics, logs, traces in a beautiful web UI.

    • Project mention: Nightingale – Open-source alternative to Prometheus&amp;Grafana | /r/bkup | 2023-08-24

  • Self-Hosting-Guide

    Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.

    • Project mention: Self-Hosted Is Awesome | news.ycombinator.com | 2024-04-13

  • highlight

    highlight.io: The open source, full-stack monitoring platform. Error monitoring, session replay, logging, distributed tracing, and more.

    • Project mention: Show HN: An open source performance monitoring tool | news.ycombinator.com | 2024-02-01

  • hyperdx

    Resolve production issues, fast. An open source observability platform unifying session replays, logs, metrics, traces and errors powered by Clickhouse and OpenTelemetry.

    • Project mention: Show HN: HyperDX Local – Open-source Datadog alternative for local debugging/dev | news.ycombinator.com | 2024-04-02

    Hi HN, Mike and Warren here! We’ve been building an open source local-dev-friendly mode for HyperDX (hyperdx.io). It's a single Docker container that lets you view logs, metrics, and traces for local development in a similar way you can use them for production (live tail, filter/correlate logs & spans, build charts, flamegraph, etc.) Basically, imagine you can run Datadog in a single container for local development. We does this by spinning up an OpenTelemetry collector, Clickhouse DB and HyperDX UI all in a single container - it only takes a few seconds to start and lets you start live tailing your local logs and traces immediately (and graph metrics of course).

    README (w/ demo gif): https://github.com/hyperdxio/hyperdx/blob/main/LOCAL.md

    We started building local mode as it became one of our most loved [1] community issue after sharing HyperDX. It made sense - as we constantly use HyperDX to debug our own issues locally, and have found it to be a huge productivity boost for things like…

    1. Tailing multiple container logs (and grepping/isolating them) without a ton of different terminal splits open at the same time.

    2. Be able to sensibly view structured logs and correlated traces to debug local issues (because you’re using structured logging and tracing right?) instead of adding ad-hoc console statements that print out exactly what I could’ve gotten from tracing.

    3. Testing telemetry are actually emitting/correlating as expected, before shipping it all the way out to prod and realizing I accidentally created a very expensive high-cardinality metric or a span that has the wrong properties.

    We spent some time packaging & tuning our existing OSS stack to run in a single container with less memory/space requirements by staring at `dive` to slim down the image and applied incantations from documentation until memory usage improved. Additionally we removed a few non-local-friendly things like authentication requirements and extraneous services.

    It still has all the goodness you’d want - so you can full text search your logs/traces, live tail all your events, view spans correlated with logs (and vice versa), create dashboards based on logs, metrics, traces, and is fully OpenTelemetry compatible - just point your Otel SDK/collector to http://localhost:4318 (or 4317 for the grpc folks) and you’re already good to go.

    I’m excited to share what we’ve been working on and would love to hear your feedback and opinions!

    Spin up the container yourself to try it out:

    docker run -p 8000:8000 -p 4318:4318 -p 4317:4317 -p 8080:8080 -p 8002:8002 hyperdx/hyperdx-local

    Main Open Source Repo: https://github.com/hyperdxio/hyperdx

    Hosted Demo (in case you want to play around in a cloud sandbox instead): https://api.hyperdx.io/login/demo

    HyperDX Landing Page: https://hyperdx.io

    [1]: https://github.com/hyperdxio/hyperdx/issues/7

  • pixie

    Instant Kubernetes-Native Application Observability

    • Project mention: Grafana Beyla: OSS eBPF auto-instrumentation for application observability | news.ycombinator.com | 2023-09-13

  • kube-state-metrics

    Add-on agent to generate and expose cluster-level metrics.

    • Project mention: Do we have any Prometheus metric to get the kubernetes cluster-level CPU/Memory requests/limits? | /r/kubernetes | 2023-07-11

  • ThreatMapper

    Open source cloud native security observability platform. Linux, K8s, AWS Fargate and more.

    • Project mention: ThreatMapper: Open-source cloud native security observability platform | news.ycombinator.com | 2023-09-10

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Observability related posts

Index

What are some of the best open-source Observability projects? This list will help you:

Project Stars
1 Netdata 68,064
2 skywalking 23,234
3 jaeger 19,370
4 kibana 19,279
5 cilium 18,510
6 signoz 16,886
7 zipkin 16,713
8 vector 16,427
9 Prefect 14,586
10 kubesphere 14,301
11 thanos 12,577
12 VictoriaMetrics 10,826
13 kubeshark 10,541
14 pyroscope 9,380
15 openobserve 9,368
16 howtheysre 8,918
17 nightingale 8,781
18 Self-Hosting-Guide 8,506
19 highlight 6,869
20 hyperdx 6,082
21 pixie 5,262
22 kube-state-metrics 5,086
23 ThreatMapper 4,631

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com