Monitoring Plotting at Scale (WIP)

• plotman

  37 921 0.0 Python

  Chia plotting manager

In our current setup we have plotting nodes, harvester nodes, and a full chia node. We're running plotman on the plotters, and a small custom utility to discover and rsync completed plots on remote plotting nodes to the least-full disk across all the harvesters. Farmers and plotters are automatically provisioned with SaltStack and can be plotting in minutes.

• prometheus

  381 52,748 9.9 Go

  The Prometheus monitoring system and time series database.

  

We're using Prometheus, Grafana, and node_exporter to derive simple server statistics, but currently writing some metric exporters that use the various Chia process RPC endpoints together with harvester/plotting log tailing to derive even more useful statistics of the processes.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• node_exporter

  78 10,315 8.9 Go

  Exporter for machine metrics

  

We're using Prometheus, Grafana, and node_exporter to derive simple server statistics, but currently writing some metric exporters that use the various Chia process RPC endpoints together with harvester/plotting log tailing to derive even more useful statistics of the processes.

• Grafana

  379 60,395 10.0 TypeScript

  The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.

  

We're using Prometheus, Grafana, and node_exporter to derive simple server statistics, but currently writing some metric exporters that use the various Chia process RPC endpoints together with harvester/plotting log tailing to derive even more useful statistics of the processes.

Suggest a related project