aws-graviton-getting-started VS autoscaler

EMR serverless + Athena + Glue works for us. We are evaluating Graviton instance to further optimize stuff. AWS link if you are interested

Now we turn our attention to carbon emissions which are presented in Table 8. In the table, the AMD – CPU only and AMD – T408 server watts/hour are actual measurements on the test system during operation. To estimate the AWS server watts/hour, we reduced the CPU-only AMD number by 60%, which is the savings that Amazon claims that Graviton3 CPUs provide over other CPUs. In all three cases, we multiplied this by the number of servers, then hours, days, and years, to compute the three-year power consumption total.

https://aws.amazon.com/ec2/graviton/ https://cloud.google.com/compute/docs/instances/arm-on-compute

From the relevant product page [0]:

"AWS Graviton3 processors feature always-on memory encryption, dedicated caches for every vCPU, and support for pointer authentication."

Further reading on pointer authentication [1].

[0] https://aws.amazon.com/ec2/graviton/

[1] https://www.qualcomm.com/content/dam/qcomm-martech/dm-assets...

Amazon makes their own Arm CPUs, like the Graviton3: https://aws.amazon.com/ec2/graviton/

Read More about Graviton Processors

According to BlackBerry, both QNX and IVY can run on EC2 instances powered by AWS’ Graviton2 processor. Graviton2 is an internally-developed processor that AWS debuted at re:Invent last year. It promises to provide up to 40% better price performance than comparable chips. "

We use Cluster Autoscaler to automatically adjust the number of nodes (cluster size) based on your actual usage to ensure efficiency. Additionally, we deploy Vertical and Horizontal Pod Autoscalers to scale your applications' resources as their needs change automatically.

> * Hetzner: cheap, good service, the finest pets in the world, no cattle

You can absolutely do cattle with Hetzner. They support imaging and immutable infrastructure. They don't have a native auto scaling equivalent, but if you're using Kubernetes, they have a cluster autoscaler: https://github.com/kubernetes/autoscaler/blob/master/cluster...

Here we take the VPA as a starting point to analyze the design and implementation principles of the VPA in Autoscaler. The source code for this article is based on Autoscaler HEAD fbe25e1.

Autoscaling over EKS can be accomplished using either the cluster-autoscaler project or Karpenter. If you want to use Spot instances, consider using Karpenter, as it has better integrations with AWS for optimizing spot pricing and availability, minimizing interruptions, and falling back to on-demand nodes if no spot instances are available.

Autoscaling is already provided on OVH, but we don't use it for now. Autoscaler has to be manually installed on the AWS/EKS cluster.

do you mean this: https://github.com/kubernetes/autoscaler/blob/master/vertical-pod-autoscaler/pkg/recommender/README.md

Read more about this scaler in detail here!

We have a default node group of Linux hosts, but there's a secondary nodegroup of Windows hosts that is typically scaled down to 0. When a team's build runs, a pod is scheduled based on their definition. Cluster-autoscaler will check the nodeSelector and automatically spin up a node from that nodegroup if necessary.

I am running a Kubernetes cluster(AWS EKS one) with Autoscaler pod So that Cluster will autoscale according to the resource request within the cluster.