AutoSpotting
terraform-aws-email-files-dropped-in-s3
Our great sponsors
| AutoSpotting | terraform-aws-email-files-dropped-in-s3 | |
|---|---|---|
| 10 | 3 | |
| 2,281 | 5 | |
| 0.8% | - | |
| 3.9 | 4.1 | |
| 10 months ago | about 1 year ago | |
| Go | HCL | |
| OpenSSL License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AutoSpotting
-
Farewell to the Era of Cheap EC2 Spot Instances
There's a service that handles obtaining the cheapest spot instances to your specs by a former aws engineer https://github.com/LeanerCloud/AutoSpotting
Effectively, it starts up cheap spot instances (based on specified criteria) across a variety of instance types to replace whatever regular instance in an autoscaling group comes online and then spins down the regular instance.
EG: That m4a you wanted may be expensive... but nobody is using m4ad so it's 85% off and it meets the specified CPU/RAM requirements... auto spotting will spin it up instead.
Having used it on and off over the years it is sometimes eyebrow raising to see 4xl boxes running cheaper than the xl box they replaced :)
-
Using ChatGPT to write a chrome extension as my first non trivial web development project
I've been heavily using ChatGPT on my autospotting.io software, where it 3-5x my productivity, releasing in 6 weeks more improvements than in the previous 6 months combined: https://github.com/LeanerCloud/AutoSpotting/discussions/489
-
Show HN: I built a service to help companies reduce AWS spend by 50%
Relevant: https://github.com/cloudutil/AutoSpotting
I've seen some third party services that automate migration to / replacement with spot instances, but haven't used them yet personally.
Going serverless, in many places, has been the most effective cost optimization for me.
- Configuring ASG to spin up spot instances first but fall back to on-demand?
- Autospotting on AWS
-
Ec2instances.info now has Spot pricing information, is there anything else you'd like to see?
I've also been maintaining a Golang library that essentially exposes the same data structure used under the hood by ec2instances.info as a Golang data structure, which is very convenient for embedding into other tools that can do lots of things with this raw data, like I do it in my AutoSpotting project.
-
Is there any way for an ASG to automatically failover from Spot Instances to on-demand instances?
I think autospotting can do this.
-
AWS Compute Savings Plan for Dev Environment
https://github.com/AutoSpotting/AutoSpotting is an interesting project that might help you with implementing this. It will automatically swap-out on-demand instances for spot and auto-restart as on-demand if spot capacity disappears.
-
Bare-Metal Kubernetes with K3s
we scale up to about 100 machines. We use spot instances EXTENSIVELY. And that configuration was tricky actually. Its been a couple of months now. Works pretty ok.
k3s is actually pretty simple to use now. the tricky part was to integrate with https://github.com/kubernetes/cloud-provider-aws and https://github.com/DirectXMan12/k8s-prometheus-adapter
The hardest part is to get it to work with spot instances. we use https://github.com/AutoSpotting/AutoSpotting to integrate with it.
terraform-aws-email-files-dropped-in-s3
-
Using ChatGPT to write a chrome extension as my first non trivial web development project
- this OSS Terraform module for sending emails with attachments after files are uploaded to S3, using Python and boto with SES https://github.com/LeanerCloud/terraform-aws-email-files-dropped-in-s3
-
Is there a typical setup for building and deploying python to lambda using terraform?
For Python you can do the packaging with Terraform, have a look here https://github.com/LeanerCloud/terraform-aws-email-files-dropped-in-s3/blob/main/main.tf
-
Email files from S3 as an attachment.
I built this today using ChatGPT and works pretty well: https://github.com/LeanerCloud/terraform-aws-email-files-dropped-in-s3 My use case covers sending me the CSV files dropped into my S3 bucket by the AWS Marketplace "reporting feature" and I got it work for that, this will save me a lot of time to log in to my account just to download and open those files. I didn't test other file types but it may work, otherwise let me know and I'll see what I can do. Also pushed it to the TF registry here https://registry.terraform.io/modules/LeanerCloud/email-files-dropped-in-s3/aws/latest
What are some alternatives?
ec2instances.info - Amazon EC2 instance comparison site
chalice - Python Serverless Microframework for AWS
amazon-ec2-instance-selector - A CLI tool and go library which recommends instance types based on resource criteria like vcpus and memory
Chalice-PynamoDB-Docker-Starter-Kit - A starter kit with some boilerplate code for getting started making low-cost serverless applications in Python on AWS with a great local development setup via Docker Compose
osv - OSv, a new operating system for the cloud.
awstaghelper - AWS bulk tagging tool
aws-lambda-extensions - A collection of sample extensions to help you get started with AWS Lambda Extensions
ec2-instances-info - Golang library for specs and pricing information about AWS EC2 instances based on the data from www.ec2instances.info
metalk8s - An opinionated Kubernetes distribution with a focus on long-term on-prem deployments
savings-estimator - Desktop application for Windows, Mac and Linux that can be used to estimate your Spot savings and optionally prepare configuration for our AutoSpotting Spot optimization engine.
kubernetes - ArgoCD-based configuration for the OCF Kubernetes cluster
ec2-macos-init - EC2 macOS Init is the launch daemon used to initialize Mac instances within EC2.