test-run
YCSB
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
test-run
-
Ten-year experience in DBMS testing
We use our own tool to run tests, test-run.py. Nowadays it may not seem reasonable to write a test runner from scratch, but it already exists, and we support it. There are different types of tests in the project — unit tests are written in C and run as binaries. Like for TAP tests, test-run.py analyzes their output in the TAP format in terms of test script success:
YCSB
- Yahoo Cloud Serving Benchmark (YCSB)
-
Ten-year experience in DBMS testing
For performance testing, we also run common benchmarks: the popular YCSB (Yahoo! Cloud Serving Benchmark), NoSQLBench, LinkBench, SysBench, TPC-H, and TPC-C. We also run C Bench, our own Tarantool API benchmark. Its primitive operations are written in C, and scripts are described in Lua.
-
Apache Cassandra 4.0: Taming Tail Latencies with Java 16 ZGC
Most benchmarks of non-relational databases are done with either product-specific tooling (like cassandra-stress), or with YCSB, which gives you a lowest-common-denominator key-value workload across dozens of systems.
What are some alternatives?
luatest - Tarantool test framework written in Lua
nosqlbench - The open source, pluggable, nosql benchmarking suite.
luaunit - LuaUnit is a popular unit-testing framework for Lua, with an interface typical of xUnit libraries (Python unittest, Junit, NUnit, ...). It supports several output formats (Text, TAP, JUnit, ...) to be used directly or work with Continuous Integration platforms (Jenkins, Maven, ...).
tarantool - Get your data in RAM. Get compute close to data. Enjoy the performance.
msgpuck - A simple and efficient MsgPack binary serialization library in a self-contained header file
jepsen.tarantool - Jepsen tests for Tarantool
small - Specialized memory allocators
cbench - Tarantool C Bench - a simple tool to benchmark Tarantool internal API