SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Go S3 Projects
-
Project mention: has anyone tried integrating govulncheck in their CI workflow? | reddit.com/r/golang | 2023-01-31
https://github.com/minio/minio/blob/master/.github/workflows/vulncheck.yml works for us.
-
rclone
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
Rclone
-
InfluxDB
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.
-
seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Project mention: Open source cloud file system. Posix, HDFS and S3 compatible | news.ycombinator.com | 2023-02-08Adopted SeaweedFS few months back. Never looked back since then. It's fast even on HDD disks.
-
thanos
Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
Project mention: Prometheus vs EFS: I don't know who to believe | reddit.com/r/sysadmin | 2023-01-24You could look at something like Thanos and store your data in S3: https://thanos.io/
-
Project mention: SQLite-based databases on the Postgres protocol? Yes we can | news.ycombinator.com | 2023-01-25
- Ben is developing https://github.com/superfly/litefs at Fly after stopping the streaming replication effort https://github.com/benbjohnson/litestream/issues/8
- And, of course, SQLite has announced a new backend that hopes to support concurrent writes and streaming replication: https://sqlite.org/hctree/doc/hctree/doc/hctree/index.html
What a time for SQLite
-
Project mention: Open source cloud file system. Posix, HDFS and S3 compatible | news.ycombinator.com | 2023-02-08
Atomic file/directory renames/moves is the fundamental feature of JuiceFS, which makes it truely a file system rather than a proxy to S3, please check the docs for all the compatibility details [1].
-
SFTPGo
Fully featured and highly configurable SFTP server with optional HTTP/S, FTP/S and WebDAV support - S3, Google Cloud Storage, Azure Blob
-
SonarLint
Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
-
-
Project mention: WAL-G 2.0: backup and restore for database in the cloud | news.ycombinator.com | 2022-06-23
-
We are going to use an official MinIO client called mc. I use macOS so installation is quite easy. The process supposes to be similar on different platforms.
-
Go
-
Project mention: Those using AWS, have you ever tried to use AWS Transfer Family to transfer files into an S3 bucket? Can I use python to make these uploads, and if so how do I set it up in aws? | reddit.com/r/aws | 2022-10-18
Some folks say https://github.com/peak/s5cmd is faster than the two options above.
-
-
docker-volume-backup
Backup Docker volumes locally or to any S3, WebDAV, Azure Blob Storage or SSH compatible storage
Project mention: Online-Speicher als Backup für (teilw. vertrauliche) Dokumente? | reddit.com/r/de_EDV | 2023-01-02 -
There's another benchmark somewhere showing S3 can max out a 100Gbps instance.
https://github.com/dvassallo/s3-benchmark
Another potential issue is ListBucket rate limiting. If you have lots of small objects, you'll spend most of the time waiting to discover the names than transferring data
-
Project mention: Learning K3s at Home, troubles with S3 Storage | reddit.com/r/kubernetes | 2022-11-19
This is the repo I am trying to use to setup s3 storage for config files of services.
-
-
-
-
-
twitter-clone
🕊 Twitter Clone developed using Go + Vue 3 + Vite + TailwindCSS + PostgreSQL + Redis (by HotPotatoC)
-
Project mention: SFTPGo VS ftpserver - a user suggested alternative | libhunt.com/r/sftpgo | 2022-02-10
Golang based autonomous FTP server with SFTP, S3, Dropbox, and Google Drive connectors.
-
Project mention: A Web GUI for managing S3 buckets written in Golang !! | reddit.com/r/golang | 2022-08-06
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Go S3 related posts
- Open source cloud file system. Posix, HDFS and S3 compatible
- Interview about Proton Drive
- Systemd rclone auto mount-- what am I missing
- Ask HN: How are you transferring thousands of small files across networks?
- How to update OpenMediaVault on RPI to Google Cloud?
- Simpleton in need of simpleton solution.
- Best OS for Virtual Machines?
-
A note from our sponsor - #<SponsorshipServiceOld:0x00007fea617d8a90>
www.saashub.com | 9 Feb 2023
Index
What are some of the best open-source S3 projects in Go? This list will help you:
Project | Stars | |
---|---|---|
1 | minio | 37,386 |
2 | rclone | 36,862 |
3 | seaweedfs | 16,462 |
4 | thanos | 11,402 |
5 | litestream | 8,030 |
6 | juicefs | 7,345 |
7 | SFTPGo | 5,555 |
8 | goofys | 4,501 |
9 | wal-g | 2,459 |
10 | mc | 2,361 |
11 | minio-go | 1,827 |
12 | s5cmd | 1,484 |
13 | clickhouse-backup | 875 |
14 | docker-volume-backup | 765 |
15 | s3-benchmark | 687 |
16 | csi-s3 | 578 |
17 | helm-s3 | 487 |
18 | mort | 478 |
19 | Walrus | 452 |
20 | storage | 419 |
21 | twitter-clone | 391 |
22 | ftpserver | 351 |
23 | s3manager | 237 |