ara VS elk-ansible

Also worth considering is ARA for playbook reporting, and then whatever you want for orchestration (Jenkins, Azure Devops, Rundeck, etc).

Why not use ara?

For general recording of playbook activity with a web dashboard, ARA works really well.

If you don’t want any UI / access control then you can also look at ARA - https://ara.recordsansible.org This works as a callback plugin to capture the job run data.

ara records ansible playbooks and makes them easier to understand and troubleshoot.

I'm not sure how to interpret running 100 debug messages (https://github.com/ansible-community/ara/blob/master/tests/integration/benchmark_tasks.yaml) into real life performance. Mitogen's Benchmark used either 100 times a "hostname" command on the target machine (https://github.com/mitogen-hq/mitogen/blob/master/tests/ansible/bench/loop-100-items.yml) or running the DebOps project (https://github.com/debops/debops-playbooks/blob/master/playbooks/common.yml) for some sorta real-world module usage.

Reach out on Mastodon or see this issue on GitHub.

I do not know if this would help but https://ara.recordsansible.org/ offers some sort of visibility and visual approach. setup might take some time but it can offer information, also it uses some sort of plugin which logs a lot of stuff, which Ara reads and offers the mentioned stuff above.

Maybe ansible ara is what you‘re searching for.

On a high level, here are the super basics that I think about when planning for huge networks, and for the inevitable performance testing you'll be doing. And of course, to actually figure out wtf is actually happening at such massive scales, my trusty ELK clusters have never failed me! But I genuinely commiserate with you about the pain and suffering that comes with sifting through millions of lines of logs to find...whatever you're looking for.