Streaming Data from Cloud Storage with Mountpoint for Amazon S3

1. mountpoint-s3

   1 18 4,990 9.6 Rust

   A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

   

   In this post, we will describe our first impressions of Mountpoint for Amazon S3 - a new open-source solution for interfacing with cloud storage - and assess its performance on two use cases that are of particular interest to us: streaming sequential blocks of a relatively large data files (as detailed here) and consuming a large number of relatively small data files (as detailed here). For the sake of brevity, we will refer to Mountpoint for Amazon S3 simply as Mountpoint.

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. fuser

   2 1 914 7.3 Rust

   Filesystem in Userspace (FUSE) for Rust

   

   Mountpoint is a new FUSE based solution written in the Rust programming language and based on a Rust version of the Linux FUSE library. See here for an explanation of the choice of Rust. Other popular tools in the FUSE-based family of solutions are goofysand s3fs.

4. rust

   3 2,801 102,063 10.0 Rust

   Empowering everyone to build reliable and efficient software.

   

   Mountpoint is a new FUSE based solution written in the Rust programming language and based on a Rust version of the Linux FUSE library. See here for an explanation of the choice of Rust. Other popular tools in the FUSE-based family of solutions are goofysand s3fs.

5. libfuse

   4 23 5,543 9.3 C

   The reference implementation of the Linux FUSE (Filesystem in Userspace) interface

   

   Mountpoint is a new FUSE based solution written in the Rust programming language and based on a Rust version of the Linux FUSE library. See here for an explanation of the choice of Rust. Other popular tools in the FUSE-based family of solutions are goofysand s3fs.

6. goofys

   5 17 5,298 0.0 Go

   a high-performance, POSIX-ish Amazon S3 file system written in Go

   

   # install goofys\ sudo curl -Lo \\ /usr/local/bin/goofys \\ https://github.com/kahing/goofys/releases/latest/download/goofys\ sudo chmod +x /usr/local/bin/goofys # install mount-s3\ wget \\ https://s3.amazonaws.com/mountpoint-s3-release/latest/x86_64/mount-s3.deb\ sudo dpkg -i mount-s3.deb\ sudo apt-get install -f -y

7. s3fs-fuse

   6 59 8,974 9.0 C++

   FUSE-based file system backed by Amazon S3

   

   Mountpoint is a new FUSE based solution written in the Rust programming language and based on a Rust version of the Linux FUSE library. See here for an explanation of the choice of Rust. Other popular tools in the FUSE-based family of solutions are goofysand s3fs.

Suggest a related project