Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Go Filesystem Projects
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
TMSU
TMSU lets you tags your files and then access them through a nifty virtual filesystem from any other application.
-
goutil
💪 Helper Utils(700+): int, byte, string, array/slice, map, struct, dump, convert/format, error, web/http, cli/flag, OS/ENV, filesystem, system, test/assert, time and more. Go 常用的一些工具函数：数字，字符串，数组，Map，结构体，反射，文本，文件，错误，时间日期，特殊处理，格式化，常用信息获取等等
-
-
-
distribyted
Torrent client with HTTP, fuse, and WebDAV interfaces. Start exploring your torrent files right away, even zip, rar, or 7zip archive contents!
-
-
-
hackpadfs
An extensible file system abstraction for Go. File systems, composable interfaces, and test suites.
-
switchboard
Auto-magic file organisation and routing for all your machines. :open_file_folder: (by Cian911)
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Not sure these are really popular, but I cannot resist advertising a few utilities written in Go that I regularly use in my daily workflow:
- gdu: a NCDU clone, much faster on SSD mounts [1]
- duf: a `df` clone with a nicer interface [2]
- massren: a `vidir` clone (simpler to use but with fewer options) [3]
- gotop: a `top` clone [4]
- micro: a nice TUI editor [5]
Building this kind of tools in Go makes sense, as the executables are statically compiled and are thus easy to install on remote servers.
[1]: https://github.com/dundee/gdu
[2]: https://github.com/muesli/duf
[3]: https://github.com/laurent22/massren
[4]: https://github.com/xxxserxxx/gotop
[5]: https://github.com/zyedidia/micro
Project mention: South Korea's No.1 Search Engine Chose JuiceFS over Alluxio for AI Storage | dev.to | 2024-01-18Support for Kerberos keytab files
The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).
Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.
So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that
Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX
That's why the blog post has the following links to POSIX-on-top-of-S3-objects :
https://github.com/s3fs-fuse/s3fs-fuse
https://github.com/kahing/goofys
https://www.cuno.io/
I'm looking to improve my documents syncing setup. Currently I'm using owncloud, but that seems overkill for just files syncing and it requires maintenance, so I gave Syncthing a look. The "Untrusted device encryption" was not appealing to me because I'm not convinced by the security aspects yet, and also because it is in beta for now. I used gocryptfs [1] in the past and was quite happy with it, so I'm planning to use it on top of Syncthing to have files synced encrypted. As far as I have read this setup (Syncthing + gocryptfs) seems to be used by several people and has already been discussed by gocryptfs' author, who recommended a `-sharedstorage` flag for such use case [2]. Reading [3] I think gocryptfs is more suited for files syncing than cryfs. I'm aware that the metadata (file size, structure, …) of my files are not encrypted but that's a compromise I'm ready to make.
I would be happy to hear about opinions about this approach.
[1] https://nuetzlich.net/gocryptfs/
[2] https://github.com/rfjakob/gocryptfs/issues/549#issuecomment...
[3] https://www.cryfs.org/comparison
Not sure these are really popular, but I cannot resist advertising a few utilities written in Go that I regularly use in my daily workflow:
- gdu: a NCDU clone, much faster on SSD mounts [1]
- duf: a `df` clone with a nicer interface [2]
- massren: a `vidir` clone (simpler to use but with fewer options) [3]
- gotop: a `top` clone [4]
- micro: a nice TUI editor [5]
Building this kind of tools in Go makes sense, as the executables are statically compiled and are thus easy to install on remote servers.
[1]: https://github.com/dundee/gdu
[2]: https://github.com/muesli/duf
[3]: https://github.com/laurent22/massren
[4]: https://github.com/xxxserxxx/gotop
[5]: https://github.com/zyedidia/micro
Project mention: GitHub issues from top Open Source Golang Repositories that you should contribute to | dev.to | 2024-01-15s5cmd - Extended character support for s3 compatible backend
https://github.com/oniony/TMSU/wiki/FAQ#why-does-tmsu-not-au...
There are a couple very barebones wrappers around mv and rm, though they could be better (pass through arguments, etc.).
https://github.com/oniony/TMSU/wiki/Tricks-and-Tips#filesyst...
Project mention: Release v0.6.10 · gookit/goutil - 💪 Helper Utils(700+): int, byte, string, array/slice, map, struct, dump, convert/format, error, web/http, cli/flag, OS/ENV, filesystem, system, test/assert, time and more. | /r/golang | 2023-07-04
Project mention: What's the most pratical solution for someone who wants to use Linux as their primary OS but often has to deal with Windows-exclusive software and services? | /r/linuxquestions | 2023-12-06onedriver is a native Linux filesystem for Microsoft OneDrive: - https://github.com/jstaf/onedriver
Project mention: Tree-shaking, the horticulturally misguided algorithm | news.ycombinator.com | 2024-04-13A lazy chunked delivery strategy like used in the k8s stargz-snapshotter[0] project could be effective here, where it only pulls chunks as needed, but it would probably require wasm platform changes.
[0] https://github.com/containerd/stargz-snapshotter
Project mention: Superfile: Pretty fancy and modern terminal file manager | news.ycombinator.com | 2024-04-22
Project mention: South Korea's No.1 Search Engine Chose JuiceFS over Alluxio for AI Storage | dev.to | 2024-01-18Support for template Secrets
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Go Filesystem related posts
- Simple Tape File System (STFS), a file system for tapes and tar files
- South Korea's No.1 Search Engine Chose JuiceFS over Alluxio for AI Storage
- Go: What We Got Right, What We Got Wrong
- File Integrity and checksums
- How to Build a Ceph Cluster and Integrate with the JuiceFS File System
- Syncthing: Untrusted Device Encryption
- What's the most pratical solution for someone who wants to use Linux as their primary OS but often has to deal with Windows-exclusive software and services?
-
A note from our sponsor - InfluxDB
www.influxdata.com | 24 Apr 2024
Index
What are some of the best open-source Filesystem projects in Go? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | duf | 12,249 |
| 2 | juicefs | 9,791 |
| 3 | goofys | 5,031 |
| 4 | gocryptfs | 3,291 |
| 5 | gdu | 3,255 |
| 6 | mc | 2,690 |
| 7 | s5cmd | 2,308 |
| 8 | TMSU | 1,981 |
| 9 | go-fuse | 1,933 |
| 10 | goutil | 1,814 |
| 11 | onedriver | 1,749 |
| 12 | hubfs | 1,602 |
| 13 | stargz-snapshotter | 1,040 |
| 14 | distribyted | 1,015 |
| 15 | fscrypt | 854 |
| 16 | superfile | 313 |
| 17 | afs | 290 |
| 18 | hackpadfs | 239 |
| 19 | enigma | 223 |
| 20 | switchboard | 197 |
| 21 | juicefs-csi-driver | 192 |
| 22 | got | 128 |
| 23 | nav | 126 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com