OpenBench
OpenBench is a Distributed SPRT Testing Framework for Chess Engines (by AndyGrant)
fishtest
The Stockfish testing framework (by official-stockfish)
| OpenBench | fishtest | |
|---|---|---|
| 1 | 23 | |
| 126 | 259 | |
| - | 2.7% | |
| 9.3 | 9.1 | |
| 7 days ago | 6 days ago | |
| Python | Python | |
| GNU General Public License v3.0 only | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
OpenBench
Posts with mentions or reviews of OpenBench.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-12-10.
-
Interested in creating, playing and testing your own chess engine?
you can have a look at openbench maybe, https://github.com/AndyGrant/OpenBench . It is currently a testing framework for chess engines (only invited ones) or fishtest. https://tests.stockfishchess.org/tests Stockfish testing framework. Both of these test if change A beats the master version using statistics. Both look at the git repository and download it and create/compile the engine, that might be another solution for you.
fishtest
Posts with mentions or reviews of fishtest.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-09.
- Discussion on whether a buffer overflow bug involving illegal positions in Stockfish (#1 ranked chess engine) could lead to remote code execution on the user's machine
- Getting Projects to Attach on old BOINC Versions
-
Interested in creating, playing and testing your own chess engine?
you can have a look at openbench maybe, https://github.com/AndyGrant/OpenBench . It is currently a testing framework for chess engines (only invited ones) or fishtest. https://tests.stockfishchess.org/tests Stockfish testing framework. Both of these test if change A beats the master version using statistics. Both look at the git repository and download it and create/compile the engine, that might be another solution for you.
-
Acquisition of Chess Knowledge in AlphaZero
[4]: https://github.com/glinscott/fishtest/wiki/Regression-Tests#...
-
~20TBs on Striped Hard Drives / RAID0: What kind of hardware to support this setup?
FishTest has thousands of computers running 24/7 https://tests.stockfishchess.org/tests. Nerds at gcp,aws,universities burn thousands of GPU hours on lc0-client just to watch their GPUs warm up. They aren't just attaching 20tb of endgames to an old macbook.
-
Does (human + computer) combo beat computer?
if removing any rng from stockfish would gain elo it would be merged. If you think it gains elo feel free to submit a test to https://tests.stockfishchess.org/tests , but it doesn't so what your saying makes no sense.
-
What are some chess960 positions that are winning for white
Where did you get these numbers from? https://github.com/glinscott/fishtest/wiki/Regression-Tests shows an elo difference of 351.3 elo points. This is further exaggerated by the fact that sf9 lacks nnue and is particularly weak at the starting position and consequently 960 starting positions.
-
Stockfish 15 is now available
In https://github.com/glinscott/fishtest/wiki/Regression-Tests you can see 8moves_v3.pgn opening book (09/11/2013 - current) with a link:
-
What makes SF15 better than 14? I mean, what do they do/program to improve performance?
You can see the various code changes in https://github.com/glinscott/fishtest/wiki/Regression-Tests . Both the actual change and the elo change from the code change.
-
Stockfish 15 is ready!
Current progression test is still in progress but you can see all of the previous ones here: https://github.com/glinscott/fishtest/wiki/Regression-Tests
What are some alternatives?
When comparing OpenBench and fishtest you can also consider the following projects:
lichess-bot - A bridge between Lichess API and chess engines
Stockfish - A free and strong UCI chess engine
chess-library - C++ chess library
fishnet - Distributed Stockfish analysis for lichess.org
nnue-pytorch - Stockfish NNUE (Chess evaluation) trainer in Pytorch
FatTitz - A chess engine based on cfish.
maia-chess - Maia is a human-like neural network chess engine trained on millions of human games.
Ceres - Ceres - an MCTS chess engine for research and recreation
docker-nginx-proxy-letsencrypt - Automated nginx proxy with letsencrypt client inside. DEPRECATED in favor of docker-letsencrypt-nginx-proxy-companion.
berserk - Python client for the lichess API
helm-cabin - Web UI that visualizes Helm releases in a Kubernetes cluster
berserk - UCI Chess Engine written in C