Seaweed File System

SeaweedFS is a distributed object store and file system to store and serve billions of files fast! Object store has O(1) disk seek, transparent cloud integration. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV. (by chrislusf)

Seaweed File System Alternatives

Similar projects and alternatives to Seaweed File System
  • Visual Studio Code

    Visual Studio Code

  • go

    The Go programming language

  • kubernetes

    Production-Grade Container Scheduling and Management

  • hugo

    The world’s fastest framework for building websites.

  • terraform

    Terraform enables you to safely and predictably create, change, and improve infrastructure. It is an open source tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.

  • esbuild

    An extremely fast JavaScript bundler and minifier

  • rancher

    Complete container management platform

  • micro-editor

    A modern and intuitive terminal-based text editor

  • vscodium

    binary releases of VS Code without MS branding/telemetry/licensing

  • Fiber

    ⚡️ Express inspired web framework written in Go

  • sops

    Simple and flexible tool for managing secrets

  • v2ray-core

    A platform for building proxies to bypass network restrictions.

  • 7days-golang

    7 days golang programs from scratch (web framework Gee, distributed cache GeeCache, object relational mapping ORM framework GeeORM, rpc framework GeeRPC etc) 7天用Go动手写/从零实现系列

  • go-zero

    go-zero is a web and rpc framework written in Go. It's born to ensure the stability of the busy sites with resilient design. Builtin goctl greatly improves the development productivity.

  • quic-go

    A QUIC implementation in pure go

  • ferry

    本系统是集工单统计、任务钩子、权限管理、灵活配置流程与模版等等于一身的开源工单系统,当然也可以称之为工作流引擎。 致力于减少跨部门之间的沟通,自动任务的执行,提升工作效率与工作质量,减少不必要的工作量与人为出错率。

  • terraform-provider-azurerm

    Terraform provider for Azure Resource Manager

  • mergerfs

    a featureful union filesystem

  • SVG Gauge

    Minimalistic, animated SVG gauge. Zero dependencies

  • sandcrawler

    Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki

NOTE: The number of mentions on this list indicates mentions on common posts. Hence, a higher number means a better alternative or higher similarity.

Posts

Posts where Seaweed File System has been mentioned. We have used some of these posts to build our list of alternatives and similar projects - the last one was on 2021-01-12.
  • I received first-ever donation on my open-source side project and it felt great
    news.ycombinator.com | 2021-01-12
    I am receiving $337 per month as of now for https://github.com/chrislusf/seaweedfs

    Not something to be proud of if including the time spent to evolve the project.

  • Ask HN: Where to get cheap VPS with big storage?
    news.ycombinator.com | 2021-01-10
    > Could you provide more details on this? Are you saying accessing the metadata will be a bottleneck (via E.g., a relational database)?

    It's the problem of having too many small files. Explained here https://github.com/chrislusf/seaweedfs#introduction.

    > Also, what do you mean by fill/rebalance in this context?

    Assuming you are replicating the data. You have to be careful of cascading failures if repairing replication is too slow because of slow network/disk-io/cpu.

    news.ycombinator.com | 2021-01-10
    Lowest I've seen is https://www.hetzner.com/dedicated-rootserver/sx62 at 1.6€ / TB / month. Anyone seen lower ?

    You should be extra careful on big servers with little bandwidth, you might need a month to fill/empty/rebalance them.

    How will you host the images ? Metadata will become a bottleneck before hdd size.

    Check out https://github.com/chrislusf/seaweedfs

  • Use the distributed file system as a Key-Large-Value store
    news.ycombinator.com | 2020-12-29
    I am working on SeaweedFS, and developed a feature that should be interesting.

    Basically, it enhances a distributed key value store, such as Redis/Cassandra/HBase/MongoDB to a distributed key-large-value store, by storing large values as files to SeaweedFS. The smaller values can be optionally stored in the KV store directly, saving one network hop.

    Let me what you think.

    https://github.com/chrislusf/seaweedfs/wiki/Filer-as-a-Key-Large-Value-Store

  • Distributed Key Value Store With Good On Disk
    reddit.com/r/bigdata | 2020-12-29
    I am working on SeaweedFS, in which meta data are stored in most common key value stores, such as Redis/Cassandra/MongoDB/etc. Basically you can use SeaweedFS as a key-large-value store, with configurable replications. You can also configure that the larger values are stored as objects on data nodes, and smaller values are stored in the key value store directly. https://github.com/chrislusf/seaweedfs/wiki/Filer-as-a-Key-Large-Value-Store
    reddit.com/r/Database | 2020-12-29
    I am working on SeaweedFS. You can use it as a key-large-value store directly, with configurable replications. https://github.com/chrislusf/seaweedfs/wiki/Filer-as-a-Key-Large-Value-Store
  • Distributed storage with friends
    In the mean time I found this: https://github.com/chrislusf/seaweedfs. It looks like it may work, I was going to try this somewhere this week.
  • Fast and easily scalable self-hosted storage solution
    MinIO seems quite good from my standpoint (single binary, compatibility w/ S3 tooling, etc). My only concern is: it seems to be quite annoying with regards to scaling with heterogeneous clusters. Let's say I currently have 3 servers - one with 8*5TB and 2 with 4*10TB - and I'm about to add 2 new servers with 3*10TB... (https://docs.minio.io/docs/minio-federation-quickstart-guide.html / https://github.com/minio/minio/issues/7411). SeaweedFS's interface seems a lot easier: you can simply join an existing master: https://github.com/chrislusf/seaweedfs#start-volume-servers...
  • Gopher Gold #15 - Wed Oct 14 2020
    dev.to | 2020-10-14
    chrislusf/seaweedfs (Go): SeaweedFS is a distributed object store and file system to store and serve billions of files fast! Object store has O(1) disk seek, transparent cloud integration. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV.

Stats

Basic Seaweed File System repo stats
7
11,340
9.9
7 days ago

chrislusf/seaweedfs is an open source project licensed under Apache License 2.0 which is an OSI approved license.