-
-
mountpoint-s3
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
I've been working on a project (s3m - https://github.com/s3m/s3m/) to address the challenge of storing Mariabackup backups in S3 buckets, particularly on systems with limited resources. The project aims to handle data streams efficiently. For instance, creating a database backup stream can impact system performance, leading to potential cluster locks. The effort required for stream creation is proportional to the database size, with larger databases demanding more time and system resources. The goal is to optimize this process, ensuring data integrity without overwhelming system resources.
