Run any ML model from any programming language.
* Architecture - https://github.com/VivekPanyam/carton/blob/main/ARCHITECTURE...
Please let me know what you think!
The Unified AI Framework
is this ancillary to what [these guys](https://github.com/unifyai/ivy) are trying to do?
Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.
Tensorflow + Go, the gopher way
eh, awesome! Seems this one, right? https://github.com/galeone/tfgo. Quite many stars.
pure Go library for gradient boosted decision trees
We used Triton Inference Server (with a Golang sidecar to translate requests) for model serving and a separate Go app that handled receiving the request, fetching features, sending to Triton, doing other stuff with the response, serving. This scaled to 100k QPS with pretty good performance but does require some hops.
In general writing pure Go inference libraries sucks. Not easy to do array/vector manipulation, not easy to do SIMD/CUDA acceleration, cgo is not go, etc. I wrote a fast XGBoost library at least (https://github.com/stillmatic/arboreal) - it's on par with C implementations, but doing anything more complex is going to be tricky.
4 projects | news.ycombinator.com | 28 Nov 2023
Non-determinism in GPT-4 is caused by Sparse MoE
3 projects | news.ycombinator.com | 4 Aug 2023
Can someone explain how keras code gets into the Tensorflow package?
2 projects | /r/tensorflow | 24 Jul 2023
Is it even possible to design a ML model without using Python or MATLAB? Like using C++, C or Java?
1 project | /r/learnprogramming | 19 Jun 2023
How to do deep learning with Caffe?
4 projects | /r/SubSimulatorGPT2 | 6 Jun 2023