Run inference at scale (by cortexlabs)

Cortex Alternatives

Similar projects and alternatives to cortex
  • TTS

    :robot: :speech_balloon: Deep learning for Text to Speech (Discussion forum:

  • go

    The Go programming language

  • Gin

    Gin is a HTTP web framework written in Go (Golang). It features a Martini-like API with much better performance -- up to 40 times faster. If you need smashing performance, get yourself some Gin.

  • build-web-application-with-golang

    A golang ebook intro how to build a web with golang

  • go-ethereum

    Official Go implementation of the Ethereum protocol

  • go-kit

    A standard library for microservices.

  • LeetCode-Go

    ✅ Solutions to LeetCode by Go, 100% test coverage, runtime beats 100% / LeetCode 题解

  • PhotoPrism

    Personal Photo Management powered by Go and Google TensorFlow

  • micro

    Micro is a platform for cloud native development

  • dapr

    Dapr is a portable, event-driven, runtime for building distributed applications across cloud and edge.

  • MLflow

    Open source platform for the machine learning lifecycle

  • cilium

    eBPF-based Networking, Security, and Observability

  • sarama

    Sarama is a Go library for Apache Kafka 0.8, and up.

  • AdGuardHome

    Network-wide ads & trackers blocking DNS server

  • goimports

    [mirror] Go Tools

  • Wails

    Create desktop apps using Go and Web Technologies.

  • Mastering_Go_ZH_CN

    《Mastering GO》中文译本,《玩转 GO》。

  • terraform-provider-azurerm

    Terraform provider for Azure Resource Manager

  • prysm

    Go implementation of the Ethereum 2.0 blockchain

  • apple-store-helper

    Apple Store iPhone预约助手

NOTE: The number of mentions on this list indicates mentions on common posts. Hence, a higher number means a better alternative or higher similarity.


Posts where cortex has been mentioned. We have used some of these posts to build our list of alternatives and similar projects - the last one was on 2021-01-06.
  • [P] Cortex 0.26: Beta support for GCP, micro-batching, and more
    Take this config for instance. path: s3://cortex-examples/tensorflow/iris-classifier/nn/ could become path: gs://cortex-examples/tensorflow/iris-classifier/nn/.
  • Cortex 0.26: Machine learning inference at scale | 2021-01-11
  • Cortex 0.26: Serverless machine learning inference | 2021-01-07
  • Deep-learning text-to-speech tool for generating voices of various characters | 2021-01-06
    The price of GPU inference can be brutal, but there's a lot you can do on the infra side to improve it:

    - Spot instances

    - Aggressive autoscaling

    - Micro batching

    Can reduce inference compute spend by huge amounts (90% is not uncommon). ML, especially anything involving realtime inference, is an area where effective platform engineering makes a ridiculous difference even in the earliest days.

    Source: I help maintain open source ML infra for GPU inference and think about compute spend way too much

  • Cortex: An open source alternative to AWS SageMaker endpoints | 2021-01-05
  • If your team does ML, what is your "MLOps" stack? | 2021-01-04
    We currently use Cortex for deployment/serving (we're on AWS), and are pretty happy with it. We tried Kubeflow, but could never get it working effectively. It sounds like a good idea, just too unwieldy. We're also currently looking at some monitoring vendors (Mona Labs, in particular), but things are still early.
  • Cortex: Run inference at scale (with native support for TensorFlow)
  • Cortex: A serverless compute engine for MLOps | 2021-01-04
  • [D] Serverless for production ML
    If you're able to, I'd suggest something like Cortex to handle all the K8 stuff. It sets up autoscaling and monitoring for you. Or if you don't need horizontal scaling, any Docker solution is fine.
  • Cortex: Serverless MLOps | 2020-12-30
  • Cortex: Serverless Inference for MLOps Teams | 2020-12-29
  • Cortex: A serverless compute engine for machine learning | 2020-12-28
  • Cortex – An open source inference cluster for production-scale machine learning | 2020-12-22
  • Gopher Gold #20 - Wed Nov 18 2020 | 2020-11-17
    cortexlabs/cortex (Go): Deploy machine learning models to production


Basic cortex repo stats
1 day ago

cortexlabs/cortex is an open source project licensed under Apache License 2.0 which is an OSI approved license.