Show HN: Carton – Run any ML model from any programming language

• carton

  4 418 8.4 Rust

  Run any ML model from any programming language.

  * Architecture - https://github.com/VivekPanyam/carton/blob/main/ARCHITECTURE...

  Please let me know what you think!

• InfluxDB

  www.influxdata.com featured

  Purpose built for real-time analytics at any scale. InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards.

  

• ivy

  17 14,021 9.9 Python

  Convert Machine Learning Code Between Frameworks

  

  is this ancillary to what [these guys](https://github.com/unifyai/ivy) are trying to do?

• tfgo

  6 2,408 1.5 Go

  Tensorflow + Go, the gopher way

  eh, awesome! Seems this one, right? https://github.com/galeone/tfgo. Quite many stars.

• arboreal

  1 7 5.0 Go

  pure Go library for gradient boosted decision trees

  We used Triton Inference Server (with a Golang sidecar to translate requests) for model serving and a separate Go app that handled receiving the request, fetching features, sending to Triton, doing other stuff with the response, serving. This scaled to 100k QPS with pretty good performance but does require some hops.

  In general writing pure Go inference libraries sucks. Not easy to do array/vector manipulation, not easy to do SIMD/CUDA acceleration, cgo is not go, etc. I wrote a fast XGBoost library at least (https://github.com/stillmatic/arboreal) - it's on par with C implementations, but doing anything more complex is going to be tricky.

Suggest a related project