Our great sponsors
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
Debuggability: We also built etcd data storage analysis tool using boltdb library and flamegraph to visualize data storage breakdown. Page cache used by kube-apiserver is counted towards a cgroup’s memory limit, and anonymous memory usage can steal page cache usage for the same cgroup. (force cgroup to reclaim as many pages reclaimed as possible if memory usage is approaching limit.)
Debuggability: We also built etcd data storage analysis tool using boltdb library and flamegraph to visualize data storage breakdown. Page cache used by kube-apiserver is counted towards a cgroup’s memory limit, and anonymous memory usage can steal page cache usage for the same cgroup. (force cgroup to reclaim as many pages reclaimed as possible if memory usage is approaching limit.)
The kube-apiserver started to first experience latency spikes and increased error rate, and then get Out of Memory (OOM) killed due to resource limit. The unbound retry from Kubelets resulted in a 7x jump on kube-apiserver load. The burst of writes caused etcd to reach its total data size limit and start rejecting all write requests, and the platform lost availability in terms of workload management.