Go HDFS

Open-source Go projects categorized as HDFS
Edit details
Topics: object-storage Posix S3 Distributed Systems Go
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 3 Go HDFS Projects

  • seaweedfs

    SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

    • Project mention: Ask HN: What distributed file system would you use in 2024? | news.ycombinator.com | 2024-05-10

  • juicefs

    JuiceFS is a distributed POSIX file system built on top of Redis and S3.

    • Project mention: Smooth Upgrade: Implementation and Usage | dev.to | 2024-05-10

    In the past, upgrading JuiceFS versions or modifying mount parameters required users to remount the file system. This causes temporary interruptions in service. Once the underlying file system service is interrupted, it affects the normal operation of other components in the system. To avoid such issues, we’ve introduced the smooth upgrade feature in the latest release of JuiceFS 1.2. This allows users to restart or upgrade without service downtime. In this post, we’ll share how we implemented the smooth upgrade feature and how to use it.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • hdfs

    A native go client for HDFS

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go HDFS related posts

  • DuckDB + dbt for a serverless event correlation pipeline?

    1 project | /r/dataengineering | 7 Dec 2023

  • SeaweedFS

    1 project | /r/devopspro | 9 Jun 2023

  • Experience running rook-ceph in production/large clusters

    1 project | /r/kubernetes | 21 Apr 2023

  • SeaweedFS is a fast distributed storage system for blobs, objects and files

    1 project | news.ycombinator.com | 3 Apr 2023

  • SeaweedFS vs JuiceFS

    1 project | dev.to | 16 Feb 2023

  • Open source cloud file system. Posix, HDFS and S3 compatible

    5 projects | news.ycombinator.com | 8 Feb 2023

  • Looking for SeaweedFS experiences

    1 project | /r/selfhosted | 14 Dec 2022
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 10 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source HDFS projects in Go? This list will help you:

Project Stars
1 seaweedfs 21,123
2 juicefs 9,836
3 hdfs 1,348

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com