Go google-cloud-storage

Open-source Go projects categorized as google-cloud-storage

Top 13 Go google-cloud-storage Projects

google-cloud-storage
  • rclone

    "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

    Project mention: Show HN: Horizon – Private alternative to Imgur | news.ycombinator.com | 2024-07-17
  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • migrate

    Database migrations. CLI and Golang library.

    Project mention: How to handle migrations in Golang | dev.to | 2024-06-11

    golang-migrate

  • thanos

    Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

    Project mention: Scaling Prometheus with Thanos | dev.to | 2024-07-22

    Started in November 2017, Thanos is an open-source CNCF incubating project with over 12.8k stars on GitHub. Built on top of Prometheus, Thanos aims to provide a highly available Prometheus environment with long-term storage support and a global view of metrics. Companies like Disney, Abode, eBay, SoundCloud, and ByteDance use Thanos for monitoring at scale. However, setting up Thanos can be complex and requires expertise with Prometheus and industry experience. If you want to overcome the limitations of Prometheus and set up Thanos for monitoring but don't know where to start, CloudRaft offers enterprise-grade consulting and support for Thanos that you should check out. Now, let's delve into the components of Thanos and understand its complete architecture.

  • SFTPGo

    Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob

    Project mention: What you guys are hosting instead of Nextcloud? I'm sick of it. | /r/selfhosted | 2023-11-29

    EDIT: Thanks for the recommendations from all of you!! I've chose to use the below: - Files: sftpgo - Calendar: baikal - Notes: memos (But beware, it sends opt-out telemetry) - Network folder: webdav on sftpgo

  • kopia

    Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

    Project mention: Timeshift: System Restore Tool for Linux | news.ycombinator.com | 2024-07-22
  • goofys

    a high-performance, POSIX-ish Amazon S3 file system written in Go

    Project mention: Is Posix Outdated? | news.ycombinator.com | 2023-10-19

    The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).

    Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.

    So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that

    Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX

    That's why the blog post has the following links to POSIX-on-top-of-S3-objects :

    https://github.com/s3fs-fuse/s3fs-fuse

    https://github.com/kahing/goofys

    https://www.cuno.io/

  • lakeFS

    lakeFS - Data version control for your data lake | Git for data

    Project mention: A Step-by-Step Guide to Implementing Data Version Control | dev.to | 2023-09-04

    # Download the LakeFS binary wget https://github.com/treeverse/lakeFS/releases/latest/download/lakefs # Make the binary executable chmod +x lakefs # Initialize LakeFS with S3 as the storage backend ./lakefs init --backend s3 --s3-gateway-endpoint --s3-region --s3-force-path-style --s3-access-key --s3-secret-key

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • berglas

    A tool for managing secrets on Google Cloud

    Project mention: How to deploy a Django app to Google Cloud Run using Terraform | dev.to | 2024-01-01

    Secret Manager: secure storage for sensitive data e.g passwords.

  • fake-gcs-server

    Google Cloud Storage emulator & testing library.

    Project mention: Show HN: Winglang – a new Cloud-Oriented programming language | news.ycombinator.com | 2023-12-06

    > not really.. as soon as you need cloud resources that are not in your k8s cluster, you end up with the cloud in your development loop.

    https://github.com/localstack/awscli-local

    https://github.com/fsouza/fake-gcs-server

    https://cloud.google.com/sdk/docs/downloads-docker

    I’ve used all of these locally to great success.

    Glad to hear you guys want to interop with npm. Is wing going to be a superset of js then?

  • helm-gcs

    Manage Helm 3 repositories on Google Cloud Storage 🔐 **privately**

  • csi-gcs

    Kubernetes CSI driver for Google Cloud Storage

  • Google-Cloud-Guide

    Google Cloud Platform (GCP) Guide. Learn all about Google Cloud Tools, Services, and Certifications.

  • gcs-sftp-server

    SFTP Server with backing storage via Google Cloud Storage (GCS)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go google-cloud-storage discussion

Log in or Post with

Go google-cloud-storage related posts

  • How do you handle sensitive variables with a service-worker?

    1 project | /r/Firebase | 11 Dec 2023
  • Very strange behavior/bug - devices stuck together

    1 project | /r/bcachefs | 7 Dec 2023
  • Kopia: Open-Source Backup Software

    1 project | news.ycombinator.com | 14 Sep 2023
  • How I backup my servers (2023)

    1 project | news.ycombinator.com | 25 Aug 2023
  • [HIRING] Seasoned developer to build a desktop backup application using Kopia and Minio

    1 project | /r/ForHire_Programmers | 4 Aug 2023
  • Self-hosted backup manager with web UI?

    1 project | /r/selfhosted | 28 Jun 2023
  • How do you back up system dirs like /etc?

    1 project | /r/linux | 22 Jun 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 23 Jul 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source google-cloud-storage projects in Go? This list will help you:

Project Stars
1 rclone 45,223
2 migrate 14,618
3 thanos 12,790
4 SFTPGo 8,614
5 kopia 6,788
6 goofys 5,115
7 lakeFS 4,232
8 berglas 1,231
9 fake-gcs-server 1,007
10 helm-gcs 278
11 csi-gcs 152
12 Google-Cloud-Guide 133
13 gcs-sftp-server 11

Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com

Did you konow that Go is
the 4th most popular programming language
based on number of metions?