cortex
Production infrastructure for machine learning at scale (by cortexlabs)
OpenFaaS
OpenFaaS - Serverless Functions Made Simple (by openfaas)
| cortex | OpenFaaS | |
|---|---|---|
| 33 | 56 | |
| 7,989 | 24,515 | |
| 0.1% | 0.4% | |
| 2.2 | 6.8 | |
| 11 months ago | 19 days ago | |
| Go | Go | |
| Apache License 2.0 | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cortex
Posts with mentions or reviews of cortex.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-02-10.
- Ask HN: Are there any reliable benchmarks for Machine Learning Model Serving?
-
Local text generation (InferKit alternative)
I found GPT-2 with PyTorch, Cortex, and Transformers.
-
Why ML should be written as pipelines from the get-go
Technologies: Flask/FastAPI, Kubernetes, Docker, Cortex, Seldon
-
[P] I made tinymodels.io to deploy models quickly, feel free to use for your prototypes and web demos
oh I see - that's neat. I think cortex.dev had some support for that sort of thing. It is? was? a wrapper to manage an EKS cluster for you and it could do things like hot swap what's in ram, autoscale, or use spot instances to save costs.
- Containers as a service on AWS
- Containers as a Service on AWS
-
How would you go about deploying transformer based model?
I use cortex.dev for deploying my models. I have successfully deployed finetuned T5s, which seems similar to your usecase.
-
Microservice on ECS having burst load issue
Arghs, my bad, yeah, doesn't seem to be available yet. But maybe Cortex might help: https://github.com/cortexlabs/cortex
- Self-hosted AWS Lambda alternative
OpenFaaS
Posts with mentions or reviews of OpenFaaS.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-02-20.
- Serverless Functions, Made Simple
-
The 2024 Web Hosting Report
Serverless functions are now offered by many cloud providers, as well as having options like OpenFaaS, Knative, Apache's Openwhisk and more from the open source community that run in environments ranging from one server all the way up to globally replicated private clusters.
-
⚡⚡ Level Up Your Cloud Experience with These 7 Open Source Projects 🌩️
OpenFaaS
-
Spinning up docker containers from http requests
Did you consider running knative or openfaas? https://github.com/openfaas/faas
-
.NET 8 Standalone 50% Smaller On Linux
Anyone knows other alternatives for Azure Functions, but for DIY hosting? ( eg. OpenFaas - https://www.openfaas.com/ )
- A question about how pods creation with requests
-
What exists on the spectrum between a cron job and airflow?
Maybe OpenFaaS with grafana and slack notifications for non-200 responses?
-
I need a custom resource somewhere between a job and cron job -- does it exist?
OpenFaaS - https://www.openfaas.com
-
Hosting strategy suggestions
By the way, if your organization is leveraging EKS as a platform and your DevOps team is willing to enable this operator, there's an exciting tool called OpenFaaS. Essentially, it enables you to host your Lambda functions on your own infrastructure instead of relying on the public cloud provider.
-
Questions for Heroku-like Project
This is where I see K8S coming in – teachers can provide dev deployments that are setup for students to learn. Teachers can also provide containers that run automated tests against the student containers for assessment! Plus, we can smooth over some of the git workflow stuff for the ripest of beginners; we can integrate with github to sync their work on our platform to repositories on their github account, so that they can really take ownership of the work they do on the platform. Last, students can graduate their work from development into production very easily, since we can take the base images + student diffs, build a new "prod" image for the student. We can run students' prod work on "serverless" K8S frameworks like fission or OpenFaas to be able to host many low-traffic "production" apps at the same time.
What are some alternatives?
When comparing cortex and OpenFaaS you can also consider the following projects:
MLflow - Open source platform for the machine learning lifecycle
IronFunctions - IronFunctions - the serverless microservices platform by
golang-design-pattern - 设计模式 Golang实现－《研磨设计模式》读书笔记
LocalStack - 💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
oauth2 - Go OAuth2
dapr - Dapr is a portable, event-driven, runtime for building distributed applications across cloud and edge.
prysm - Go implementation of Ethereum proof of stake
OpenWhisk - Apache OpenWhisk is an open source serverless cloud platform
terraform-provider-azurerm - Terraform provider for Azure Resource Manager
fn - The container native, cloud agnostic serverless platform.
zenml - ZenML 🙏: MLOps framework to create reproducible ML pipelines for production machine learning. [Moved to: https://github.com/zenml-io/zenml]
Appwrite - Your backend, minus the hassle.