Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x

1. dirac

   1 18 0 - TypeScript

   Open Source Coding Agent singularly focused efficiency. Reduces API costs by 50-80% vs other agent AND improves the code quality at the same time. Uses Hash Anchored edits, massively parallel operations, AST manipulation and many many other optimizations. https://dirac.run/

   

   Do you have instructions on how to run a custom harness against this? There are none on the linked page. I want to run Dirac (https://github.com/dirac-run/dirac).

2. Kargo

   akuity.io sponsored

   Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.

   

3. maki

   2 22 993 9.9 Rust

   An efficient AI coding agent extendable by neovim-like Lua plugins

   

4. frontier-harness-eval

   3 1 18 7.7 JavaScript

   Public results and task definitions for FrontierHarness Eval

   

5. hangar-harness-model-tests

   4 1 0 4.2 HTML

   

   https://github.com/alvins82/hangar-harness-model-tests/

   OMP i would say comes out on this prompt the best out of all the harnesses i've tried. I suspect possibly a lot of this is to do with the base system prompt that each harness injects.

Suggest a related project