AutoSpotting
osv
Our great sponsors
AutoSpotting | osv | |
---|---|---|
10 | 7 | |
2,282 | 4,032 | |
0.8% | 0.5% | |
3.4 | 8.9 | |
8 days ago | about 1 month ago | |
Go | C | |
OpenSSL License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AutoSpotting
-
Farewell to the Era of Cheap EC2 Spot Instances
There's a service that handles obtaining the cheapest spot instances to your specs by a former aws engineer https://github.com/LeanerCloud/AutoSpotting
Effectively, it starts up cheap spot instances (based on specified criteria) across a variety of instance types to replace whatever regular instance in an autoscaling group comes online and then spins down the regular instance.
EG: That m4a you wanted may be expensive... but nobody is using m4ad so it's 85% off and it meets the specified CPU/RAM requirements... auto spotting will spin it up instead.
Having used it on and off over the years it is sometimes eyebrow raising to see 4xl boxes running cheaper than the xl box they replaced :)
-
Using ChatGPT to write a chrome extension as my first non trivial web development project
I've been heavily using ChatGPT on my autospotting.io software, where it 3-5x my productivity, releasing in 6 weeks more improvements than in the previous 6 months combined: https://github.com/LeanerCloud/AutoSpotting/discussions/489
-
Show HN: I built a service to help companies reduce AWS spend by 50%
Relevant: https://github.com/cloudutil/AutoSpotting
I've seen some third party services that automate migration to / replacement with spot instances, but haven't used them yet personally.
Going serverless, in many places, has been the most effective cost optimization for me.
- Configuring ASG to spin up spot instances first but fall back to on-demand?
- Autospotting on AWS
-
Ec2instances.info now has Spot pricing information, is there anything else you'd like to see?
I've also been maintaining a Golang library that essentially exposes the same data structure used under the hood by ec2instances.info as a Golang data structure, which is very convenient for embedding into other tools that can do lots of things with this raw data, like I do it in my AutoSpotting project.
-
Is there any way for an ASG to automatically failover from Spot Instances to on-demand instances?
I think autospotting can do this.
-
AWS Compute Savings Plan for Dev Environment
https://github.com/AutoSpotting/AutoSpotting is an interesting project that might help you with implementing this. It will automatically swap-out on-demand instances for spot and auto-restart as on-demand if spot capacity disappears.
-
Bare-Metal Kubernetes with K3s
we scale up to about 100 machines. We use spot instances EXTENSIVELY. And that configuration was tricky actually. Its been a couple of months now. Works pretty ok.
k3s is actually pretty simple to use now. the tricky part was to integrate with https://github.com/kubernetes/cloud-provider-aws and https://github.com/DirectXMan12/k8s-prometheus-adapter
The hardest part is to get it to work with spot instances. we use https://github.com/AutoSpotting/AutoSpotting to integrate with it.
osv
-
Gokrazy – Go Appliances
I've been looking at a few.
https://github.com/cloudius-systems/osv
https://ops.city/ (also nanovms) - this is one that I actually got working to at least demo state
-
Writing an OS in Rust to run on RISC-V
I have also found OSv to be interesting.
https://osv.io/
-
A future without containers? ( thoughts )
Wow, just now seeing this topic. I work for a cloud company hosted in AWS. We started out, Netflix/Spotify style microservices. We were all on ec2 images generate by packer (and later with AWS Image Factory). When Docker hit, we kicked the tires but never did anything with it beyond using it for running unit tests, and later, infrastructure tests. 5 years ago, during a hackathon, our little group began experimenting with Unikernels, or library operating systems. Interestingly enough, these Unikernels were all stripped down BSD kernels. OSv is FreeBSD based, and Rumprun is NetBSD based. Services running in EC2 on Unikernels would spin up and start sending and receiving traffic before the AWS EC2 healthchecks completed. They are blazing fast! Only problem in 2017, was the tooling. It would have taken too much effort to use Unikernals with our infrastructure. As soon as they start making Unikernels that can run Java bytecode like native code, the fate of containerization will be sealed, IMO. We could get basic JVM webservers running on OSv, but not Cassandra, not Kafka, not yet. OSv now runs on Firecracker, but I have not tried it out, yet. Some links if you are interested: OSv: https://osv.io Rumprun: https://github.com/rumpkernel/rumprun We used this tooling during the Hackathon, but doesn't look like it has been touched in 3 years: https://github.com/solo-io/unik Unikraft Unikernel Dev kit: https://unikraft.org/ And don't forget Firecracker running in Kubernetes https://www.weave.works/oss/firekube/ And of course, being a FreeBSD subreddit, let's not forget FreeBSD on Firecracker https://www.daemonology.net/blog/2022-10-18-FreeBSD-Firecracker.html
-
Nanos: A kernel designed to run one and only one application
Whats the difference to OSv?
https://github.com/cloudius-systems/osv
-
Two Unikernel talks at P99 CONF
OSv Unikernel — Optimizing Guest OS to Run Stateless and Serverless Apps in the Cloud — Waldek Kozaczuk [OSv Committer] Unikernels have been demonstrated to deliver excellent performance in terms of throughput and latency, while providing high isolation. However they have also been shown to underperform in some types of workloads when compared to a generic OS like Linux. In this presentation, we demonstrate that certain types of workloads - web servers, microservices, and other stateless and/or serverless apps - can greatly benefit from OSv optimized networking stack and other features. We describe number of experiments where OSv outperforms Linux guest: most notably we note 1.6 throughput (req/s) and 0.6 latency improvement (at p99 percentile) when running nginx and 1.7 throughput (req/s) and 0.6 latency improvement (at p99 percentile) when running simple microservice implemented in Golang. We also show that OSv' small kernel, low boot time and memory consumption allow for very high density when running server-less workloads. The experiment described in this presentation shows we can boot 1,800 OSv microVMs per second on AWS c5n.metal machine with 72 CPUs (25 boots/sec on single CPU) with guest boot time recorded as low as 8.98ms at p50 and 31.49ms at p99 percentile respectively. Lastly we also demonstrate how to automate the build process of the OSv kernel tailored exactly to the specific app and/or VMM so that only the code and symbols needed are part of the kernel and nothing more. OSv is an open source project and can be found at https://github.com/cloudius-systems/osv.
-
Bootloader Written for Java
I guess you could have a JVM like that, but not OpenJDK. There is, however, a unikernel that supports running itself and OpenJDK in the same process: http://osv.io/
-
Bare-Metal Kubernetes with K3s
> Oracle used to offer an installation mode like this
Oracle, and BEA before them, used to offer a JVM which ran on top of a thin custom OS designed only to host the JVM, you could call it a "unikernel". Product was called JRockit Virtual Edition (JRVE), WebLogic Server Virtual Edition (WLS-VE, when used to run WebLogic), earlier BEA called it LiquidVM. The internal name for that thin custom OS was in fact "Bare Metal". Similar in concept to https://github.com/cloudius-systems/osv but completely different implementation
I think one thing which caused a problem for it, is a lot of customers want to deploy various management tools to their VMs (security auditing software, performance monitoring software, etc) and when your VM runs a custom OS that becomes very difficult or impossible. So adopting this product could lead to the pain of having to ask for exceptions to policies requiring those tools and then defending the decision to adopt it against those who use those policies to argue against it. I think this is part of why the product was discontinued.
Nowadays, Oracle offers "bare metal servers" [1] – which are just hypervisor-less servers, same as other cloud vendors do. Or similarly, "Oracle Database Appliance Bare Metal System" [2] – which just means not installing a hypervisor on your Oracle Database Appliance.
So Oracle seems to have a history of using the phrase "bare metal" in both the senses being discussed here.
[1] https://www.oracle.com/cloud/compute/bare-metal.html
[2] https://docs.oracle.com/en/engineered-systems/oracle-databas...
What are some alternatives?
ec2instances.info - Amazon EC2 instance comparison site
OPS - ops - build and run nanos unikernels
amazon-ec2-instance-selector - A CLI tool and go library which recommends instance types based on resource criteria like vcpus and memory
kubernetes - ArgoCD-based configuration for the OCF Kubernetes cluster
aws-lambda-extensions - A collection of sample extensions to help you get started with AWS Lambda Extensions
nanos - A kernel designed to run one and only one application in a virtualized environment
metalk8s - An opinionated Kubernetes distribution with a focus on long-term on-prem deployments
xous-core - The Xous microkernel
ec2-macos-init - EC2 macOS Init is the launch daemon used to initialize Mac instances within EC2.
unik - The Unikernel & MicroVM Compilation and Deployment Platform