Top 6 Go amazon-s3 Projects

minio

99 44,094 9.9 Go

The Object Store for AI Data Infrastructure

Project mention: A Distributed File System in Go Cut Average Metadata Memory Usage to 100 Bytes | news.ycombinator.com | 2024-02-22

Looks like minio added this in 2022:
https://github.com/minio/minio/pull/15433

amazon-s3-tar-tool

2 151 6.9 Go

A utility tool to create a tarball of existing objects in Amazon S3
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
super-dollop

5 61 0.0 Go

Encrypt your files or notes by your GPG key and save to MinIO or AWS S3 easily!
s3sha256sum

4 10 5.3 Go

Calculate SHA256 checksums of objects on Amazon S3.

Project mention: Updating your programs for S3 Express One Zone | dev.to | 2024-01-31

s3sha256sum is a program that calculates SHA-256 checksums of S3 objects. I wrote this program before AWS launched their own feature to support checksums (which you should definitely be using as it makes your upload faster!).

s3verify

2 10 4.4 Go

Verify that a local file is identical to an object on Amazon S3, without having to download the object. :detective:

Project mention: Updating your programs for S3 Express One Zone | dev.to | 2024-01-31

s3verify is essentially the sequel to s3sha256sum which uses the new checksum feature in S3.

shrimp

5 9 6.0 Go

Simple program that reliably uploads large files to Amazon S3. :shrimp: (by stefansundin)

Project mention: Updating your programs for S3 Express One Zone | dev.to | 2024-01-31

shrimp is a program that can upload large files to S3 buckets, and it would be great if it could also upload to S3 Express One Zone.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-02-22.