Gcs

Open-source projects categorized as Gcs
Edit details
Language: + Go + Python + Rust + C + C# + Java + TypeScript
Topics: S3 Golang google-cloud-storage Python Storage
The modern identity platform for B2B SaaS
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com
Sponsored

Top 23 Gc Open-Source Projects

  • goofys

    a high-performance, POSIX-ish Amazon S3 file system written in Go

    • Project mention: Is Posix Outdated? | news.ycombinator.com | 2023-10-19

    The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).

    Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.

    So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that

    Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX

    That's why the blog post has the following links to POSIX-on-top-of-S3-objects :

    https://github.com/s3fs-fuse/s3fs-fuse

    https://github.com/kahing/goofys

    https://www.cuno.io/

  • opendal

    Apache OpenDAL: access data freely.

    • Project mention: Welcome to Apache OpenDAL | news.ycombinator.com | 2023-12-22

    Sounds likely.

    The core part of OpenDAL is a Rust crate that provides fs-like APIs over different storage backends, but we also investigate providing other interfaces like a CLI. We have an experimental binary named `oli`[1].

    You're welcome to start a discussion[2] to share how you use rclone and we may find it fit in OpenDAL's scope :D

    [1] https://github.com/apache/incubator-opendal/tree/main/bin/ol...

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • pgBackRest

    Reliable PostgreSQL Backup & Restore

    • Project mention: pgBackRest: PostgreSQL S3 backups | dev.to | 2023-08-10

    This tutorial explains how to backup PostgreSQL database using pgBackRest and S3.

  • MissionPlanner

    Mission Planner Ground Control Station for ArduPilot (c# .net)

  • rill

    Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code. (by rilldata)

    • Project mention: Governments on GitHub | news.ycombinator.com | 2023-06-09

  • fake-gcs-server

    Google Cloud Storage emulator & testing library.

    • Project mention: Show HN: Winglang – a new Cloud-Oriented programming language | news.ycombinator.com | 2023-12-06

    > not really.. as soon as you need cloud resources that are not in your k8s cluster, you end up with the cloud in your development loop.

    https://github.com/localstack/awscli-local

    https://github.com/fsouza/fake-gcs-server

    https://cloud.google.com/sdk/docs/downloads-docker

    I’ve used all of these locally to great success.

    Glad to hear you guys want to interop with npm. Is wing going to be a superset of js then?

  • grafana-backup-tool

    A Python-based application to backup Grafana settings by using the Grafana API

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • storage

    A vendor-neutral storage library for Golang: Write once, run on every storage service.

  • astro-sdk

    Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

    • Project mention: Orchestration: Thoughts on Dagster, Airflow and Prefect? | /r/dataengineering | 2023-06-01

    Have you tried the Astro SDK? https://github.com/astronomer/astro-sdk

  • helm-gcs

    Manage Helm 3 repositories on Google Cloud Storage 🔐 **privately**

  • pathy

    simple, flexible, offline capable, cloud storage with a Python path-like interface

  • boring-registry

    Terraform Provider and Module Registry

    • Project mention: OpenTF Repository is now Public | news.ycombinator.com | 2023-09-05

    https://github.com/TierMobility/boring-registry

    Disclaimer: I worked for TIER before

  • gcp-storage-emulator

    Local emulator for Google Cloud Storage

  • objstore

    Go module providing unified interface and efficient clients to work with various object storage providers until like GCS, S3, Azure, SWIFT, COS and more.

  • gcs-connector-for-apache-kafka

    Aiven's GCS Sink Connector for Apache Kafka®

  • jaeger-objectstorage

    Jaeger plugin for object storage datastore

  • f1-data-pipeline

    F1 Data Pipeline

    • Project mention: Created my first Data Engineering Project which integrates F1 data using Prefect, Terraform, dbt, BigQuery and Looker Studio | /r/dataengineering | 2023-07-01

    Github

  • golongtail

    Command line front end for longtail synchronization tool

  • gcsfs

    Golang io/fs implementation for Google Cloud Storage

  • dimutex

    asyncio Python library for distributed mutex with GCS as a backend

  • gcs-sftp-server

    SFTP Server with backing storage via Google Cloud Storage (GCS)

  • gcserve

    Serve files from a GCP bucket

  • Shopable

    A Platform to create an online store for your business. Powered by Redis Stack!

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-12-22.

Gcs related posts

Index

What are some of the best open-source Gc projects? This list will help you:

Project Stars
1 goofys 5,031
2 opendal 2,822
3 pgBackRest 2,177
4 MissionPlanner 1,621
5 rill 1,329
6 fake-gcs-server 959
7 grafana-backup-tool 794
8 storage 517
9 astro-sdk 315
10 helm-gcs 277
11 pathy 170
12 boring-registry 150
13 gcp-storage-emulator 130
14 objstore 81
15 gcs-connector-for-apache-kafka 65
16 jaeger-objectstorage 38
17 f1-data-pipeline 23
18 golongtail 21
19 gcsfs 12
20 dimutex 12
21 gcs-sftp-server 11
22 gcserve 7
23 Shopable 0

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com