SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Filesystem Open-Source Projects
-
Project mention: Level Up Your Dev Workflow: Conquer Web Development with a Blazing Fast Neovim Setup (Part 1) | dev.to | 2024-03-16
ripgrep: A super-fast file searcher. You can install it using your system's package manager (e.g., brew install ripgrep on macOS). fd: Another blazing-fast file finder. Installation instructions can be found here: https://github.com/sharkdp/fd
-
spacedrive
Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.
Project mention: Spacedrive: Unify files from all your devices and clouds into one easy explorer | news.ycombinator.com | 2023-10-19AGPLv3 (switched in 2022 https://github.com/spacedriveapp/spacedrive/commit/8e5c71dea... ) and FWIW I don't see any mention of CLA or other license assignment, so I don't believe they can currently rug pull containing contributed changes since they don't own the license for them: https://github.com/spacedriveapp/spacedrive/blob/main/CONTRI...
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
If you want a file full browser experience choose nnn: https://github.com/jarun/nnn . If you have a desktop file for Helix you can use the Gnome Files program to make all your programming language files open in Helix.
-
I also use zsh for years and did not know that. What I like this: Actually having completions shown in the screen and being able to navigate them with tabs. I think that is not a default behavior, but that is what oh-my-zsh does for you in its default setup. Does someone have more insight on that?
I did not know about this, but I use https://github.com/wting/autojump, so I am not super sad that I missed something that hold me back severely. But good to know.
-
Flysystem is a PHP project with open source code that revolutionizes work with the filesystem. It offers a unified and straightforward approach by abstracting the differences between various file system types, including local and cloud-based ones. You can utilize a consistent API to integrate it into your projects seamlessly. You can use it in any web application that works with data storage to make it more efficient and user-friendly.
-
Not sure these are really popular, but I cannot resist advertising a few utilities written in Go that I regularly use in my daily workflow:
- gdu: a NCDU clone, much faster on SSD mounts [1]
- duf: a `df` clone with a nicer interface [2]
- massren: a `vidir` clone (simpler to use but with fewer options) [3]
- gotop: a `top` clone [4]
- micro: a nice TUI editor [5]
Building this kind of tools in Go makes sense, as the executables are statically compiled and are thus easy to install on remote servers.
[1]: https://github.com/dundee/gdu
[2]: https://github.com/muesli/duf
[3]: https://github.com/laurent22/massren
-
Project mention: Why Does 'Is-Number' Package Have 59M Weekly Downloads? | news.ycombinator.com | 2024-03-04
tailwindcss -> chokidar -> braces -> fill-range -> to-regex-range -> is-number
is-number was first published 9 years ago, when these kind of micro-packages were in vogue. braces was added as a dependency to chokidar over 6 years ago [1]. And if it ain't broke, don't fix it. I don't think the average JS dev today is going out and pulling in these deps.
[1] https://github.com/paulmillr/chokidar/commit/cbdf25563cfff7f...
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
Project mention: South Korea's No.1 Search Engine Chose JuiceFS over Alluxio for AI Storage | dev.to | 2024-01-18
Support for Kerberos keytab files
-
Project mention: What are some of the best libraries you cannot work without? | /r/node | 2023-06-08
I haven't seen fs-extra mentioned yet. For my work it involves a fair bit of reading/writing to the filesystem, so this makes it quite nice to deal with everything in an async way.
-
The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).
Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.
So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that
Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX
That's why the blog post has the following links to POSIX-on-top-of-S3-objects :
https://github.com/s3fs-fuse/s3fs-fuse
-
-
And npmjs.com will block your IP if you do too many downloads in on day.
Actually is says 86m a week here: https://www.npmjs.com/package/rimraf
-
I fixed the problem, it was due to the incorrect setup of the google drive. I followed this guide to set everything up from scratch and create the folder directly in Linux instead of constantly accessing the apparently "encrypted" cloud. If anyone ever runs into the same problem, I really hope this thread is helpful :D
-
It's not really the same though. A Projected File System copies the files from the backing store to somewhere on the local file system when requested and then performs IO normally on the local files.
For an actual implementation of userspace filesystems on Windows see dokany: https://github.com/dokan-dev/dokany
-
The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).
Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.
So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that
Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX
That's why the blog post has the following links to POSIX-on-top-of-S3-objects :
https://github.com/s3fs-fuse/s3fs-fuse
-
Maybe https://github.com/itinance/react-native-fs would work? Or does TVOS even have a filesystem API?
-
Project mention: LittleFS Design (CObW) – Combining advantages of COW and log-structures | news.ycombinator.com | 2024-01-25
-
Project mention: Tell HN: ZFS silent data corruption bugfix – my research results | news.ycombinator.com | 2023-12-06
https://github.com/gluster/glusterfs/issues/894
And apparently apart from modern coreutils using that, it is mostly gentoo users hitting the bugs in lseek.
-
mountpoint-s3
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
-
-
Have a look at mergerfs.
-
-
I'm looking to improve my documents syncing setup. Currently I'm using owncloud, but that seems overkill for just files syncing and it requires maintenance, so I gave Syncthing a look. The "Untrusted device encryption" was not appealing to me because I'm not convinced by the security aspects yet, and also because it is in beta for now. I used gocryptfs [1] in the past and was quite happy with it, so I'm planning to use it on top of Syncthing to have files synced encrypted. As far as I have read this setup (Syncthing + gocryptfs) seems to be used by several people and has already been discussed by gocryptfs' author, who recommended a `-sharedstorage` flag for such use case [2]. Reading [3] I think gocryptfs is more suited for files syncing than cryfs. I'm aware that the metadata (file size, structure, …) of my files are not encrypted but that's a compromise I'm ready to make.
I would be happy to hear about opinions about this approach.
[1] https://nuetzlich.net/gocryptfs/
[2] https://github.com/rfjakob/gocryptfs/issues/549#issuecomment...
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Filesystem related posts
- Why Does 'Is-Number' Package Have 59M Weekly Downloads?
- LittleFS Design (CObW) – Combining advantages of COW and log-structures
- LittleFS Design
- South Korea's No.1 Search Engine Chose JuiceFS over Alluxio for AI Storage
- Go: What We Got Right, What We Got Wrong
- Unix as IDE: Introduction (2012)
- Littlefs – a little fail-safe filesystem designed for microcontrollers
-
A note from our sponsor - SaaSHub
www.saashub.com | 28 Mar 2024
Index
What are some of the best open-source Filesystem projects? This list will help you:
Project | Stars | |
---|---|---|
1 | fd | 31,175 |
2 | spacedrive | 28,547 |
3 | nnn | 18,043 |
4 | autojump | 15,877 |
5 | Flysystem | 13,174 |
6 | duf | 12,168 |
7 | chokidar | 10,489 |
8 | juicefs | 9,675 |
9 | fs-extra | 9,332 |
10 | s3fs-fuse | 7,984 |
11 | winfsp | 6,467 |
12 | rimraf | 5,456 |
13 | google-drive-ocamlfuse | 5,334 |
14 | dokany | 5,015 |
15 | goofys | 4,995 |
16 | react-native-fs | 4,868 |
17 | littlefs | 4,701 |
18 | GlusterFS | 4,445 |
19 | mountpoint-s3 | 3,946 |
20 | xplr | 3,881 |
21 | mergerfs | 3,803 |
22 | fselect | 3,772 |
23 | gocryptfs | 3,264 |