Our great sponsors
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Hello HN! One of the creators of Cog here.
We built this to deploy models to Replicate (https://replicate.com/), but it can also be used to deploy models to your own infra.
Andreas, my co-founder and one of the creators of Cog, used to work at Spotify. Spotify wanted to run models inside Docker containers, but Docker was too hard to use for most ML researchers. So, Andreas built a set of templates and scripts to help researchers deploy their own models.
This was mixed in with my experience working at Docker. I created Docker Compose, which makes Docker easier to use for dev environments. We were also joined by Zeke, who created Swagger (now OpenAPI), which is used to define a model’s inputs/outputs. And, many other contributors have since joined! https://github.com/replicate/cog#contributors-
It’s still early days, so expect a few rough edges, but it’s ready to use for deploying models. We’d love to hear what you think.