Kubernetes Cluster Over-Provisioning: Proactive App Scaling

This page summarizes the projects mentioned and recommended in the original post on dev.to

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • The helm chart uses the following configuration to overscale the cluster. 1 replica of placeholder-pod per node (with 2 core CPU and 2 Gi of memory request). For example, if the Kubernetes cluster is running with 15 nodes then 15 replicas of placeholder-pod will be there in the cluster.

  • cluster-proportional-autoscaler

    Kubernetes Cluster Proportional Autoscaler Container

  • If we want to configure dynamic overprovisioning of a cluster (e.g. 20% of resources in the cluster) then we need to use Horizontal Cluster Proportional Autoscaler.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • autoscaler

    Autoscaling components for Kubernetes

  • The Horizontal Pod Autoscaler creates additional pod when the need for them arises. But what happens when all the nodes in the cluster are at full capacity and can’t run any more pods? The Cluster Autoscaler takes care of automatically provisioning additional nodes when it notices a pod that can’t be scheduled to existing nodes because of the lack of resources on those nodes. A new node will be provisioned if, after a new pod is created and the Scheduler can’t schedule it to any of the existing nodes. The Cluster Autoscaler looks for such pods and signals the cloud provider (eg. AWS) to spin up an additional node and the problem lies in here. To provision, a new node in a cluster cloud provider may take some time (a minute or more) before the created nodes appear in Kubernetes cluster. It almost entirely depends on the cloud provider (We are using AWS) and the speed of node provisioning. It may take some time till the new pods can be scheduled.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • cert-manager: All-in-One Kubernetes TLS Certificate Manager

    2 projects | dev.to | 6 May 2024
  • ArgoCD Deployment on RKE2 with Cilium Gateway API

    2 projects | dev.to | 19 Feb 2024
  • Using k8s-apiserver as AAA server for microservices?

    4 projects | /r/kubernetes | 17 Feb 2023
  • load balancer and kubernetes

    3 projects | /r/aws | 23 Jan 2023
  • EKS: is it possible to rewrite the URL with ALB?

    1 project | /r/kubernetes | 12 Dec 2022