Go Filesystem

Open-source Go projects categorized as Filesystem

Top 23 Go Filesystem Projects

  • duf

    Disk Usage/Free Utility - a better 'df' alternative

    Project mention: PPA or not to PPA | reddit.com/r/Ubuntu | 2023-03-01

    Otherwise the last option is to get the deb/appimage files from their official git repos or website, like for my use cases, MongoDB Compass (which was not officially maintained on flatpak) or duf (not available in Ubuntu repos)

  • juicefs

    JuiceFS is a distributed POSIX file system built on top of Redis and S3.

    Project mention: Using S3 as shared storage | reddit.com/r/kubernetes | 2023-02-23
  • InfluxDB

    Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  • goofys

    a high-performance, POSIX-ish Amazon S3 file system written in Go

    Project mention: AWS Announces Open Source Mountpoint for Amazon S3 | news.ycombinator.com | 2023-03-26

    How is this different than these other solutions?

    https://github.com/kahing/goofys

    https://github.com/s3fs-fuse/s3fs-fuse

  • gocryptfs

    Encrypted overlay filesystem written in Go

    Project mention: Hertzner or other cloud encryption question | reddit.com/r/selfhosted | 2023-03-25

    https://github.com/rfjakob/gocryptfs might be a solution. I dont use it, tried to for some backups but ran into some issues unrelated to the solution itself but with my backup solution.

  • mc

    Simple | Fast tool to manage MinIO clusters :cloud:

    Project mention: Migrating data between two online MinIO instances | dev.to | 2022-07-03

    We are going to use an official MinIO client called mc. I use macOS so installation is quite easy. The process supposes to be similar on different platforms.

  • gdu

    Fast disk usage analyzer with console interface written in Go

    Project mention: How to report on usage? | reddit.com/r/zfs | 2023-03-25
  • TMSU

    TMSU lets you tags your files and then access them through a nifty virtual filesystem from any other application.

    Project mention: Files in folders and subfolders. Why are we still stuck in this era? | reddit.com/r/filesystems | 2023-03-22

    It may not be active, but: https://github.com/oniony/TMSU

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • go-fuse

    FUSE bindings for Go

    Project mention: Program for exposing digiKam database as a FUSE file system | reddit.com/r/kde | 2023-03-06

    The nice thing is there are lots of libraries out there for implementing a FUSE file system that adds a layer of abstraction over the actual kernel APIs so you don't need to deal with that low level of code. In particular I am using https://github.com/hanwen/go-fuse, which seems to be the defacto standard for FUSE with Go.

  • s5cmd

    Parallel S3 and local filesystem execution tool.

    Project mention: Those using AWS, have you ever tried to use AWS Transfer Family to transfer files into an S3 bucket? Can I use python to make these uploads, and if so how do I set it up in aws? | reddit.com/r/aws | 2022-10-18

    Some folks say https://github.com/peak/s5cmd is faster than the two options above.

  • goutil

    💪 Helper Utils For Go: int, byte, string, array/slice, map, struct, dump, convert/format, error, web/http, cli/flag, OS/ENV, filesystem, system, test/assert, time and more. Go 常用的一些工具函数:数字,字符串,数组,Map,结构体,反射,文本,文件,错误,时间日期,特殊处理,格式化,常用信息获取等等

    Project mention: GO tool library goutil released v0.6.4 | dev.to | 2023-02-11

    gookit/goutil - 💪 Helper Utils For Go: int, byte, string, array/slice, map, struct, dump, convert/format, error, web/http, cli/flag, OS/ENV, filesystem, system, test/assert, time and more.

  • onedriver

    A native Linux filesystem for Microsoft OneDrive

    Project mention: Introducing Celeste: A GUI file synchronization client that can connect to any cloud provider | reddit.com/r/linux | 2023-02-07

    There are OneDriveGUI which uses abraunegg's onedrive client as backend, onedriver which has been around with a GUI for longer, and of course the classic Insync which is paid.

  • distribyted

    Torrent client with HTTP, fuse, and WebDAV interfaces. Start exploring your torrent files right away, even zip, rar, or 7zip archive contents!

  • stargz-snapshotter

    Fast container image distribution plugin with lazy pulling

    Project mention: A Hidden Gem: Two Ways to Improve AWS Fargate Container Launch Times | dev.to | 2022-10-27

    Seekable OCI (SOCI) is a technology open-sourced by AWS that enables containers to launch faster by lazily loading the container image. It’s usually not possible to fetch individual files from gzipped tar files. With SOCI, AWS borrowed some of the design principles from stargz-snapshotter, but took a different approach. A SOCI index is generated separately from the container image and is stored in the registry as an OCI Artifact and linked back to the container image by OCI Reference Types. This means that the container images do not need to be converted, image digests do not change, and image signatures remain valid.

  • fscrypt

    Go tool for managing Linux filesystem encryption

  • afs

    Abstract File Storage

  • hackpadfs

    An extensible file system abstraction for Go. File systems, composable interfaces, and test suites.

    Project mention: Read/Write FileSystem header interface for dependency injection | reddit.com/r/golang | 2022-05-29

    Have a look at hackpadfs if you like afero but prefer a "native" abstraction

  • enigma

    🔢🔒Enigma: a simple cross-platform encrypted filesystem (by aegistudio)

    Project mention: Enigma - A simple cross-platform encrypted filesystem | reddit.com/r/CKsTechNews | 2023-01-22
  • switchboard

    Auto-magic file organisation and routing for all your machines. :open_file_folder: (by Cian911)

    Project mention: Switchboard: Auto-magic file organisation and routing for all your machines. | reddit.com/r/coolgithubprojects | 2022-12-19
  • got

    Got is like git, but with an 'o' (by gotvc)

    Project mention: Show HN: A version control system based on rsync | news.ycombinator.com | 2023-01-19

    I've not heard the term "probabilistic tree" and I've having difficulty pulling up references. I suspect it's implemented by subpackage ptree[0]. Do you have resources on what makes probabilistic trees different from hash tables?

    [0] https://github.com/gotvc/got/tree/master/pkg/gotkv/ptree

  • gtree

    Output tree🌳 or Make directories📁 from #Markdown or Programmatically. Provide CLI, Golang library and Web (using #Wasm ).

    Project mention: How can I make the process faster? | reddit.com/r/golang | 2023-02-11
  • skywalker

    A package to allow one to concurrently go through a filesystem with ease

  • go-mtree

    File systems verification utility and library, in likeness of mtree(8)

    Project mention: Creating a file with the name as the hash of another file | reddit.com/r/commandline | 2023-03-03

    There is FreeBSD utility called mtree that also ported to Linux systems, that walk specified filesystem and creates hashes for all found content which later can be used to check integrity against corruption/modification. If your distribution of choice doesn't have ported version of mtree, you can use multiplatform version go-mtree that replicate the same workflow

  • fstabfmt

    :large_blue_circle: Format /etc/fstab automatically.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-03-26.

Go Filesystem related posts

Index

What are some of the best open-source Filesystem projects in Go? This list will help you:

Project Stars
1 duf 10,791
2 juicefs 7,779
3 goofys 4,585
4 gocryptfs 2,777
5 mc 2,407
6 gdu 2,346
7 TMSU 1,826
8 go-fuse 1,695
9 s5cmd 1,567
10 goutil 1,271
11 onedriver 1,223
12 distribyted 944
13 stargz-snapshotter 807
14 fscrypt 749
15 afs 227
16 hackpadfs 218
17 enigma 211
18 switchboard 210
19 got 118
20 gtree 91
21 skywalker 87
22 go-mtree 70
23 fstabfmt 57
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com