pytest-codspeed VS _rust

CodSpeed | Founding AI Engineer | On-site (Paris) / Remote (Europe) | Full-time | https://codspeed.io

We're building software performance optimization tools to optimize and measure code performance before it is deployed to production. We avoid regressions that impact UX and help developers solve their performance issues faster. We're already live and trusted by top-tier open-source project teams such as Pydantic, Ruff, and Prisma.

We’re at an exciting early stage and looking for talented engineers who share our passion for helping to enhance the performance of software used by billions, improving the software development lifecycle, and building tools we love to use ourselves.

Apply at https://codspeed.notion.site/Founding-AI-Engineer-cd1bf4fd73...

pytest-codspeed, plugin for pytest

Really feel that this is a missing area in CI today and looking forward to what codspeed and https://bencher.dev/ are able to create.

Unfortunately, I'm not using either atm. Last I looked at them:

- codspeed's Rust integration involved stubbing out a specific benchmark library which seems non-ideal and I've moved away from that library

- bencher required manually registering your benches before using it. I have responsibility over a large number of Rust repos and try to get rid of as many per-repo steps as possible. If I can't put it in my template (https://github.com/epage/_rust) and then merge it into each of my repos to get the benefit, I'm unlikely to use it.

While I've not worked with the codspeed developers, I have been providing feedback to the bencher developers and have hope that I'll be able to eventually use a solution.