-
clickhouse-backup
Tool for easy ClickHouse backup and restore using object storage for backup files.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Similar experience to vulkoingim: steep learning curve but quite stable once deployed properly.
Schema management in zookeeper has been the biggest pain point for us. Occasionally individual clickhouse shards will get out of sync during a schema update, which can be hard to diagnose.
We use a heavily modified version of clickhouse-backup[1], which works well for us.
As for hands-off replica reboot: you must have an automated process to reapply the same schema which exists in zookeeper, otherwise it won't resync. If the local schema gets out of sync with that in zookeeper, then you'll have issues again.
I expect a lot of these ergonomics issues will be fixed over time. It's already much easier to use than it was 3 years ago, and even if progress on usability and reducing the learning curve is slow the database performance makes it worth it.
[1] https://github.com/AlexAkulov/clickhouse-backup
Related posts
-
Backing up Plausible Analytics database
-
Difference in data size for the Clickhouse backups
-
ClickHouse incremental backups
-
Backup and restore with clickhouse-backup
-
Out of a desire to backup my docker volumes, I created a small utility to periodically compress and upload a directory to S3. Since I'm only 9 months into my Rust journey, any advice is welcome!