Top 23 Go aws-s3 Projects

• migrate

  72 13,946 7.5 Go

  Database migrations. CLI and Golang library.

  

Project mention: Using migrations with Golang | dev.to | 2024-04-17

Go does not natively support the use of migrations, but we could use the ORM that has this functionality, such as GORM which is the most used by the community, but We can use migrations without using an ORM, for this we will use the golang-migrate package.

• goofys

  16 5,031 0.0 Go

  a high-performance, POSIX-ish Amazon S3 file system written in Go

Project mention: Is Posix Outdated? | news.ycombinator.com | 2023-10-19

The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).

Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.

So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that

Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX

That's why the blog post has the following links to POSIX-on-top-of-S3-objects :

https://github.com/s3fs-fuse/s3fs-fuse

https://github.com/kahing/goofys

https://www.cuno.io/

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• lakeFS

  48 4,058 9.8 Go

  lakeFS - Data version control for your data lake | Git for data

  

Project mention: A Step-by-Step Guide to Implementing Data Version Control | dev.to | 2023-09-04

# Download the LakeFS binary wget https://github.com/treeverse/lakeFS/releases/latest/download/lakefs # Make the binary executable chmod +x lakefs # Initialize LakeFS with S3 as the storage backend ./lakefs init --backend s3 --s3-gateway-endpoint --s3-region --s3-force-path-style --s3-access-key --s3-secret-key

• wal-g

  13 3,038 9.0 Go

  Archival and Restoration for databases in the Cloud

  

Project mention: WAL-G 3.0.0 – fast disaster recovery for Postgres | news.ycombinator.com | 2024-03-17

• mc

  1 2,690 9.2 Go

  Simple | Fast tool to manage MinIO clusters :cloud:

  

• Go-Clean-Architecture-REST-API

  1 641 0.0 Go

  Golang Clean Architecture REST API example

• helm-s3

  2 542 8.5 Go

  ⎈ Helm plugin that adds support for AWS S3 as a chart repository.

Project mention: Installing multiple helm charts in one go [Approach 2 - using helmfile] | dev.to | 2023-12-26

$ helm plugin list NAME VERSION DESCRIPTION diff 3.8.1 Preview helm upgrade changes as a diff helm-git 0.12.0 Get non-packaged Charts directly from Git. s3 0.14.0 Provides AWS S3 protocol support for charts and repos. https://github.com/hypnoglow/helm-s3 secrets 4.1.1 This plugin provides secrets values encryption for Helm charts secure storing

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• aws-s3-proxy

  1 317 0.0 Go

  Reverse proxy for AWS S3 with basic authentication.

• mailbox

  4 242 9.2 Go

  Versatile email infrastructure on AWS serverless

Project mention: Show HN: Versatile email infrastructure on AWS serverless | news.ycombinator.com | 2024-03-25

• jazigo

  0 210 5.6 Go

  Jazigo is a tool written in Go for retrieving configuration for multiple devices, similar to rancid, fetchconfig, oxidized, Sweet.

• govcr

  0 163 3.7 Go

  HTTP mock for Golang: record and replay HTTP/HTTPS interactions for offline testing

• amazon-s3-tar-tool

  2 153 7.0 Go

  A utility tool to create a tarball of existing objects in Amazon S3

  

• s3www

  2 151 5.0 Go

  Serve static files from any S3 compatible object storage services (Let's Encrypt ready)

• simples3

  0 132 0.0 Go

  Simple no frills AWS S3 Golang Library using REST with V4 Signing (without AWS Go SDK)

• fss3

  2 55 3.2 Go

  FSS3 is an S3 filesystem abstraction layer for Golang

• cls3

  2 42 7.4 Go

  The CLI tool "cls3" is to CLear S3 Buckets. It empties (so deletes all objects and versions/delete-markers in) S3 Buckets or deletes the buckets themselves.

Project mention: cls3, Búsqueda y Eliminación Masiva de Buckets S3 | dev.to | 2023-09-01

Binarios Releases: https://github.com/go-to-k/cls3/releases

• aws-ses-pop3-server

  1 36 9.4 Go

  The missing POP3 💌 server for Amazon Simple Email Service - written in golang.

• cnfuzz

  2 36 0.0 Go

  Breaking Cloud Native Web APIs in their natural habitat.

  

• serverless-userpics

  4 11 10.0 Go

  ⚡ Instantly get user avatars via 1 API call. Ready to use. 100 artsy avatars included. Made open-source by DevClad.

  

• s3dav-proxy

  1 9 2.5 Go

  s3dav-proxy is software that allows s3 compatible file servers to be operated via the webdav protocol.

• s3stream

  1 6 2.0 Go

  Streaming client for Amazon AWS S3

• axis-aws-rekognition

  2 1 1.8 Go

  This project is a POC of using AWS Rekognition service over persistent and secure MQTT using client certificate with axis cameras (Requires firmware version 10+). Secure MQTT is used instead of HTTPS to get less overhead with connection setup

  

• teos3

  1 0 6.7 Go

  The TeoS3 package contains Golang features that make it easy to use S3 storage as a key-value database.

  

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Go aws-s3 related posts

• Show HN: Versatile email infrastructure on AWS serverless
  1 project | news.ycombinator.com | 25 Mar 2024
• Email Inbox on AWS Serverless
  1 project | news.ycombinator.com | 20 Mar 2024
• cls3, Búsqueda y Eliminación Masiva de Buckets S3
  1 project | dev.to | 1 Sep 2023
• A tar-like utility to build archives of existing Amazon S3 objects without downloading them.
  2 projects | /r/aws | 23 Mar 2023
• Show HN: Versatile self-hosted email infrastructure
  1 project | news.ycombinator.com | 4 Jan 2023
• MinIO - Mock S3 in local development
  5 projects | dev.to | 7 Dec 2022
• Migrating instance to AWS GovCloud
  1 project | /r/aws | 1 Nov 2022
• A note from our sponsor - SaaSHub
  www.saashub.com | 26 Apr 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Go projects with our weekly report!