aws-graviton-ml-inference-apache-tvm-example
aws-graviton-getting-started
| aws-graviton-ml-inference-apache-tvm-example | aws-graviton-getting-started | |
|---|---|---|
| 1 | 62 | |
| 5 | 828 | |
| - | 2.8% | |
| 0.0 | 8.5 | |
| over 1 year ago | 15 days ago | |
| Python | Python | |
| MIT No Attribution | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aws-graviton-ml-inference-apache-tvm-example
-
2 new workshops related to AWS Graviton and Machine Learning from the AWS team itself
How to run ML inference on EC2 (Graviton | arm64) using Apache TVM (TVMC):
aws-graviton-getting-started
- AWS Graviton Technical Guide
- Cómo comenzar a trabajar con AWS Graviton: La pregunta del Millón
-
What infra did you deploy for Iceberg/Hudi/Delta?
EMR serverless + Athena + Glue works for us. We are evaluating Graviton instance to further optimize stuff. AWS link if you are interested
-
Slash CAPEX, OPEX, and Carbon Emissions with T408
Now we turn our attention to carbon emissions which are presented in Table 8. In the table, the AMD – CPU only and AMD – T408 server watts/hour are actual measurements on the test system during operation. To estimate the AWS server watts/hour, we reduced the CPU-only AMD number by 60%, which is the savings that Amazon claims that Graviton3 CPUs provide over other CPUs. In all three cases, we multiplied this by the number of servers, then hours, days, and years, to compute the three-year power consumption total.
-
Framework ARM
https://aws.amazon.com/ec2/graviton/ https://cloud.google.com/compute/docs/instances/arm-on-compute
-
Google Has Developed Its Own Data Center Server Chips
From the relevant product page [0]:
"AWS Graviton3 processors feature always-on memory encryption, dedicated caches for every vCPU, and support for pointer authentication."
Further reading on pointer authentication [1].
[0] https://aws.amazon.com/ec2/graviton/
[1] https://www.qualcomm.com/content/dam/qcomm-martech/dm-assets...
-
can i repurpose a server and make it a computer
Amazon makes their own Arm CPUs, like the Graviton3: https://aws.amazon.com/ec2/graviton/
-
Cost Cutting AWS strategies
Read More about Graviton Processors
-
Blackberry Partnership Panning Out!
According to BlackBerry, both QNX and IVY can run on EC2 instances powered by AWS’ Graviton2 processor. Graviton2 is an internally-developed processor that AWS debuted at re:Invent last year. It promises to provide up to 40% better price performance than comparable chips. "
- AWS Graviton
What are some alternatives?
aws-graviton-run-confidential-ml-workloads-using-nitro-enclaves - An example solution for running ML workloads on AWS Graviton using AWS Nitro Enclaves
drupal-pi - Drupal on Docker on a Raspberry Pi. Pi Dramble's little brother.
KasmVNC - Modern VNC Server and client, web based and secure
buildx - Docker CLI plugin for extended build capabilities with BuildKit
examples - TensorFlow examples
sysbench - Scriptable database and system performance benchmark
examples - A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
flops - Tiny cpu benchmark
aws-lambda-power-tuning - AWS Lambda Power Tuning is an open-source tool that can help you visualize and fine-tune the memory/power configuration of Lambda functions. It runs in your own AWS account - powered by AWS Step Functions - and it supports three optimization strategies: cost, speed, and balanced.
awesome-appwrite - Carefully curated list of awesome Appwrite resources 💪
solvespace - Parametric 2d/3d CAD
rowhammer-test - Test DRAM for bit flips caused by the rowhammer problem