nodeIngestBench
tsbs
Our great sponsors
nodeIngestBench | tsbs | |
---|---|---|
2 | 76 | |
3 | 1,216 | |
- | 2.2% | |
1.5 | 1.9 | |
29 days ago | about 1 month ago | |
JavaScript | Go | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nodeIngestBench
-
Ingesting with CrateDB
We used the nodeIngestBench for all the benchmarking. It is a multi-process Node.js script that runs high-performance ingest benchmarks on CrateDB. It uses a data model that was adapted from Timescale’s Time Series Benchmark Suite (TSBS). One thing that we want to make clear is that nodeIngestBench is a write benchmark. The data structure that it creates is unsuitable for any performance-indicative reading tests because of its high cardinality (due to random data) and no partitioning.
-
How we scaled ingestion to one million rows per second
nodeIngestBench: The client tool generating batched INSERT statements. Implemented in Node.js, it provides the needed high concurrency with a pool of workers that run as separate child processes.
tsbs
- tsbs: NEW Data - star count:1149.0
-
Fuzz Testing Is the Best Thing to Happen to Our Application Tests
1. correctness: from small units tests to relatively complex integrations tests. they typically populate a test database and query it via various interfaces, such as REST or the Postgres protocol. we use Azure Pipelines to execute them - testing in MacoOS, Linux (both Intel and ARM) and Windows.
2. performance: we tend to use the TSBS project for most of our performance testing and profiling. fun fact: we actually had to patch it as the vanilla TSBS was a bottleneck in some tests. Sadly, the PR with the improvements is still not merged: https://github.com/timescale/tsbs/pull/186
- tsbs: NEW Data - star count:1058.0
-
MongoDB Time Series Benchmark and Review
As usual, we use the industry standard Time Series Benchmark Suite (TSBS) as the benchmark tool. Unfortunately, TSBS upstream does not support MongoDB time series collections.
What are some alternatives?
cratedb-terraform - Terraform deployment configurations for CrateDB
QuestDB - An open source time-series database for fast ingest and SQL queries
cql-proxy - A client-side CQL proxy/sidecar.
TimescaleDB - An open-source time-series SQL database optimized for fast ingest and complex queries. Packaged as a PostgreSQL extension.
orioledb - OrioleDB – building a modern cloud-native storage engine (... and solving some PostgreSQL wicked problems) 🇺🇦
dbt-clickhouse - The Clickhouse plugin for dbt (data build tool)
Elasticsearch - Free and Open, Distributed, RESTful Search Engine
duckdb - DuckDB is an in-process SQL OLAP Database Management System
promscale - [DEPRECATED] Promscale is a unified metric and trace observability backend for Prometheus, Jaeger and OpenTelemetry built on PostgreSQL and TimescaleDB.
ClickHouse - ClickHouse® is a free analytics DBMS for big data
VictoriaMetrics - VictoriaMetrics: fast, cost-effective monitoring solution and time series database
pmacct - pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].