Rust S3

Open-source Rust projects categorized as S3
Edit details
Topics: Rust AWS Storage Backup aws-s3
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 12 Rust S3 Projects

  • mountpoint-s3

    A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

    • Project mention: Row Zero and Viewport Data Streaming | news.ycombinator.com | 2024-04-04

    ... or does "S3 file system" mean https://github.com/awslabs/mountpoint-s3 - a Rust project by AWS Labs that provides "a simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system" ?

  • Replibyte

    Seed your development database with real data ⚡️

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • roapi

    Create full-fledged APIs for slowly moving datasets without writing a single line of code.

    • Project mention: Full-fledged APIs for slowly moving datasets without writing code | news.ycombinator.com | 2023-10-25

  • opendal

    Apache OpenDAL: access data freely.

    • Project mention: Welcome to Apache OpenDAL | news.ycombinator.com | 2023-12-22

    Sounds likely.

    The core part of OpenDAL is a Rust crate that provides fs-like APIs over different storage backends, but we also investigate providing other interfaces like a CLI. We have an experimental binary named `oli`[1].

    You're welcome to start a discussion[2] to share how you use rclone and we may find it fit in OpenDAL's scope :D

    [1] https://github.com/apache/incubator-opendal/tree/main/bin/ol...

  • garage

    (Mirror) S3-compatible object store for small self-hosted geo-distributed deployments. Main repo: https://git.deuxfleurs.fr/Deuxfleurs/garage (by deuxfleurs-org)

    • Project mention: SeaweedFS fast distributed storage system for blobs, objects, files and datalake | news.ycombinator.com | 2024-02-02

    Take a look at GarageS3, it's a niceoption for "just an S3 server" for self hosting.

    https://garagehq.deuxfleurs.fr/

    I use it for self hosting.

  • git-remote-s3

    Push and pull git repos to/from an s3 bucket, encrypted using gpg.

    • Project mention: Push and pull Git repos to S3, GPG encrypted | news.ycombinator.com | 2023-08-24

  • s3s

    S3 Service Adapter (by Nugine)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • Backpack

    Highly performant and advanced self hosted file sharing platform made in Rust (by JSH32)

  • waihona

    Rust crate for performing cloud storage CRUD actions across major cloud providers e.g aws

  • s3m

    CLI for streams of data in S3 buckets

    • Project mention: s3m: A CLI for streams of data in S3 buckets | /r/rust | 2023-12-05

    I've been working on a project (s3m - https://github.com/s3m/s3m/) to address the challenge of storing Mariabackup backups in S3 buckets, particularly on systems with limited resources. The project aims to handle data streams efficiently. For instance, creating a database backup stream can impact system performance, leading to potential cluster locks. The effort required for stream creation is proportional to the database size, with larger databases demanding more time and system resources. The goal is to optimize this process, ensuring data integrity without overwhelming system resources.

  • awsbck

    Backup a folder to AWS S3, once or periodically

  • rust-s3-async-ffi

    Asynchronous streaming of AWS S3 objects in C and C++ powered by rust-s3

    • Project mention: Show HN: A practical example of using async Rust runtimes in C and C++ | news.ycombinator.com | 2024-03-30
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust S3 related posts

  • Row Zero and Viewport Data Streaming

    1 project | news.ycombinator.com | 4 Apr 2024

  • Show HN: A practical example of using async Rust runtimes in C and C++

    1 project | news.ycombinator.com | 30 Mar 2024

  • SeaweedFS fast distributed storage system for blobs, objects, files and datalake

    7 projects | news.ycombinator.com | 2 Feb 2024

  • Welcome to Apache OpenDAL

    2 projects | news.ycombinator.com | 22 Dec 2023

  • s3m: A CLI for streams of data in S3 buckets

    2 projects | /r/rust | 5 Dec 2023

  • S3 as the Storage Layer

    1 project | news.ycombinator.com | 2 Nov 2023

  • Apache OpenDAL: A unified data access layer

    1 project | news.ycombinator.com | 1 Sep 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 4 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source S3 projects in Rust? This list will help you:

Project Stars
1 mountpoint-s3 4,017
2 Replibyte 3,995
3 roapi 3,087
4 opendal 2,843
5 garage 369
6 git-remote-s3 275
7 s3s 105
8 Backpack 60
9 waihona 49
10 s3m 32
11 awsbck 5
12 rust-s3-async-ffi 2

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com