inference VS kafka-manager

Great question! I work for a computer vision company (Roboflow) and have seen computer vision used for everything from accident prevention on critical infrastructure to identifying defects on vehicle parts to detecting trading cards for use in video game applications.

Drawing bounding boxes is a common end point for demos, but for businesses using computer vision there is an entire world after that: on device deployment. This can be on devices like an NVIDIA Jetson (a very common choice), to Raspberry Pis to central CUDA GPU servers for processing large volumes of data (maybe connected to cameras over RTSP).

Note: There are many models that are faster and perform better than YOLOv5 (i.e. YOLOv8, YOLOv10, PaliGemma). Roboflow Inference that our ML team maintains has various guides on deploying models to the edge: https://inference.roboflow.com/#inference-pipeline

Yeah, inference[1] is our open source package for running locally (either directly in Python or via a Docker container). It works with all the models on Universe, models you train yourself (assuming we support the architecture; we have a bunch of notebooks available[2]), or train in our platform, plus several more general foundation models[3] (for things like embeddings, zero-shot detection, question answering, OCR, etc).

We also have a hosted API[4] you can hit for most models we support (except some of the large vision models that are really GPU-heavy) if you prefer.

[1] https://github.com/roboflow/inference

[2] https://github.com/roboflow/notebooks

[3] https://inference.roboflow.com/foundation/about/

[4] https://docs.roboflow.com/deploy/hosted-api

Are there any comparison to CMAK or Kafdrop ?

Dockerized kafka manager (Yahoo CMAK)

Cluster Manager for Apache Kafka (CMAK)

There are so many of them in big data, e.g. Kafka, Spark, Flink, Delta, Snowplow, Finagle, Deequ, CMAK, OpenWhisk, Snowflake, TheHive, TVM-VTA, etc.

We're using CMAK (previously known as kafka manager) https://github.com/yahoo/CMAK

Some random tips: * Use SSDs, not magnetic disks. Our Kafka brokers used to use magnetic disks for more throughput, but this caused wayyyy more problems, like very slow broker restarts. * You'll want to install something like Burrow so you can get better lag metrics. * You might want to install CMAK. It's a web interface for common ops tasks.

I've used Yahoo's CMAK before for these things -