elasticmq VS kafka-manager

Since a majority of services rely on the same system services, we can leverage Docker to start all the needed project services prior running services with the offline command. The template ships with a base docker-compose.yml that stands up an instance of ElasticMQ to emulate Amazon SQS's API. The Docker image can be extended to include other services like DynamoDB, Redis, or PostgresQL and can be run using yarn infrastructure:build or yarn infrastructure:start depending on if it's your first run or not.

however...we have banned use of SQS. unlike S3/Minio, there's nothing API-compatible that we can run offline. (well, there's one thing, but it's in-memory / single node only and doesn't give us the durability/reliability we want with SQS). instead we use RabbitMQ because it's identical at the API layer no matter where we are. AWS has a hosted option for this but we haven't switched to it, because our existing self-managed Rabbit clusters are stable and well-understood.

Are there any comparison to CMAK or Kafdrop ?

Dockerized kafka manager (Yahoo CMAK)

Cluster Manager for Apache Kafka (CMAK)

There are so many of them in big data, e.g. Kafka, Spark, Flink, Delta, Snowplow, Finagle, Deequ, CMAK, OpenWhisk, Snowflake, TheHive, TVM-VTA, etc.

We're using CMAK (previously known as kafka manager) https://github.com/yahoo/CMAK

Some random tips: * Use SSDs, not magnetic disks. Our Kafka brokers used to use magnetic disks for more throughput, but this caused wayyyy more problems, like very slow broker restarts. * You'll want to install something like Burrow so you can get better lag metrics. * You might want to install CMAK. It's a web interface for common ops tasks.

I've used Yahoo's CMAK before for these things -