Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.
Why do you think that https://github.com/ai-techsystems/deepC is a good alternative to OnnxStream
Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.
Why do you think that https://github.com/ai-techsystems/deepC is a good alternative to OnnxStream