BentoML VS cloud-nuke

Link to GitHub -->

there are a few tools you can use as "cheat mode" shortcuts to give you a leg up as you're getting started. here's one: https://github.com/bentoml/BentoML

Then you can look into bentoml https://github.com/bentoml/BentoML which is used to deploy ml stuff with many more benifits.

For 2), I am aware of a few options. Triton inference server is an obvious one as is the ‘transformer-deploy’ version from LDS. My only reservation here is that they require the model compilation or are architecture specific. I am aware of others like Bento, Ray serving and TorchServe. Ideally I would have something that allows any (PyTorch model) to be used without the extra compilation effort (or at least optionally) and has some convenience things like ease of use, easy to deploy, easy to host multiple models and can perform some dynamic batching. Anyway, I am really interested to hear people's experience here as I know there are now quite a few options! Any help is appreciated! Disclaimer - I have no affiliation or are connected in any way with the libraries or companies listed here. These are just the ones I know of. Thanks in advance.

In this category I’m a big fan of https://github.com/bentoml/BentoML

What I like about it is their idiomatic developer experience. It reminds me of other Pythonic frameworks like Flask and Django in a good way.

I have no affiliation with them whatsoever, just an admirer.

Github Page: https://github.com/bentoml/BentoML

- https://gruntwork.io/ - https://github.com/gruntwork-io

After discussing the testing approaches suggested by the two IaC providers Terraform and Pulumi, in the next post we will take a look at the dedicated IaC testing providers takes on this topic. Here we will have a look at Gruntwork and Snyk. So, stay tuned if you are interessted!

Or your working on gruntwork.io company, this is the only the thing that makes ok all what you say here. However I believe they can make better product instead of angry chat on reddit without getting in details.

Like others have said, your infra might itself be the product.

Look at https://gruntwork.io.

They’ve made a lucrative business by selling infra scripts that others can use.

And their subscription model means they keep the scripts up to date.

Have been checking out terragrunt and terratest lately(part of https://gruntwork.io)

Gruntwork | Software Engineers (Principal, Staff) | 100% Remote/US time zones | Full-time | https://gruntwork.io/

We aim to improve humanity's most important invention: Software. Our product enables software teams to launch and maintain production-grade cloud infrastructure in days, not months. We create the building blocks that devs use to make launching in AWS with infrastructure as code 10x better.

We work with AWS, K8s, Terraform, Go, Typescript, and React/Next. We’re a small team (~20 people), but our clients include Toyota, Adobe, TicketMaster, Verizon, and lots of startups.

We are profitable, self-funded (no investors, no debt), pay salaries, equity, and bonuses according to transparent formulas, and are very focused on building a company we're proud of. We are 100% remote, with 2/3 of our team in the USA and 1/3 in Europe. We have company-wide in-person meetups every few months. We welcome applicants from all backgrounds.

Our measure of a successful Grunt is (1) think like an owner, (2) make impact, (3) communicate effectively, (4) be a good person. If this sounds like you, we're hiring!

- Principal Software Engineer

- Staff Software Engineer

Learn more at https://gruntwork.io/careers/

Most people hesitate to use cloud hosted offerings for development. First of all, most providers have a generous free tier for devs, which can get you started. Secondly I recommend using tools like cloudnuke to avoid paying for cloud resources you're not using.