Filesystem

Open-source projects categorized as Filesystem

Top 23 Filesystem Open-Source Projects

  • fd

    A simple, fast and user-friendly alternative to 'find'

    Project mention: Level Up Your Dev Workflow: Conquer Web Development with a Blazing Fast Neovim Setup (Part 1) | dev.to | 2024-03-16

    ripgrep: A super-fast file searcher. You can install it using your system's package manager (e.g., brew install ripgrep on macOS). fd: Another blazing-fast file finder. Installation instructions can be found here: https://github.com/sharkdp/fd

  • spacedrive

    Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.

    Project mention: Spacedrive: Unify files from all your devices and clouds into one easy explorer | news.ycombinator.com | 2023-10-19

    AGPLv3 (switched in 2022 https://github.com/spacedriveapp/spacedrive/commit/8e5c71dea... ) and FWIW I don't see any mention of CLA or other license assignment, so I don't believe they can currently rug pull containing contributed changes since they don't own the license for them: https://github.com/spacedriveapp/spacedrive/blob/main/CONTRI...

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • nnn

    n³ The unorthodox terminal file manager

    Project mention: Directory navigation on Helix | /r/HelixEditor | 2023-12-06

    If you want a file full browser experience choose nnn: https://github.com/jarun/nnn . If you have a desktop file for Helix you can use the Gnome Files program to make all your programming language files open in Helix.

  • autojump

    A cd command that learns - easily navigate directories from the command line

    Project mention: Zshell | news.ycombinator.com | 2024-03-06

    I also use zsh for years and did not know that. What I like this: Actually having completions shown in the screen and being able to navigate them with tabs. I think that is not a default behavior, but that is what oh-my-zsh does for you in its default setup. Does someone have more insight on that?

    I did not know about this, but I use https://github.com/wting/autojump, so I am not super sad that I missed something that hold me back severely. But good to know.

  • Flysystem

    Abstraction for local and remote filesystems

    Project mention: Open Source Projects You Can Lay Your Hand On | /r/XBScompany | 2023-12-06

    Flysystem is a PHP project with open source code that revolutionizes work with the filesystem. It offers a unified and straightforward approach by abstracting the differences between various file system types, including local and cloud-based ones. You can utilize a consistent API to integrate it into your projects seamlessly. You can use it in any web application that works with data storage to make it more efficient and user-friendly.

  • duf

    Disk Usage/Free Utility - a better 'df' alternative

    Project mention: Go: What We Got Right, What We Got Wrong | news.ycombinator.com | 2024-01-04

    Not sure these are really popular, but I cannot resist advertising a few utilities written in Go that I regularly use in my daily workflow:

    - gdu: a NCDU clone, much faster on SSD mounts [1]

    - duf: a `df` clone with a nicer interface [2]

    - massren: a `vidir` clone (simpler to use but with fewer options) [3]

    - gotop: a `top` clone [4]

    - micro: a nice TUI editor [5]

    Building this kind of tools in Go makes sense, as the executables are statically compiled and are thus easy to install on remote servers.

    [1]: https://github.com/dundee/gdu

    [2]: https://github.com/muesli/duf

    [3]: https://github.com/laurent22/massren

    [4]: https://github.com/xxxserxxx/gotop

    [5]: https://github.com/zyedidia/micro

  • chokidar

    Minimal and efficient cross-platform file watching library

    Project mention: Why Does 'Is-Number' Package Have 59M Weekly Downloads? | news.ycombinator.com | 2024-03-04

    tailwindcss -> chokidar -> braces -> fill-range -> to-regex-range -> is-number

    is-number was first published 9 years ago, when these kind of micro-packages were in vogue. braces was added as a dependency to chokidar over 6 years ago [1]. And if it ain't broke, don't fix it. I don't think the average JS dev today is going out and pulling in these deps.

    [1] https://github.com/paulmillr/chokidar/commit/cbdf25563cfff7f...

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • juicefs

    JuiceFS is a distributed POSIX file system built on top of Redis and S3.

    Project mention: South Korea's No.1 Search Engine Chose JuiceFS over Alluxio for AI Storage | dev.to | 2024-01-18

    Support for Kerberos keytab files

  • fs-extra

    Node.js: extra methods for the fs object like copy(), remove(), mkdirs()

    Project mention: What are some of the best libraries you cannot work without? | /r/node | 2023-06-08

    I haven't seen fs-extra mentioned yet. For my work it involves a fair bit of reading/writing to the filesystem, so this makes it quite nice to deal with everything in an async way.

  • s3fs-fuse

    FUSE-based file system backed by Amazon S3

    Project mention: Is Posix Outdated? | news.ycombinator.com | 2023-10-19

    The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).

    Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.

    So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that

    Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX

    That's why the blog post has the following links to POSIX-on-top-of-S3-objects :

    https://github.com/s3fs-fuse/s3fs-fuse

    https://github.com/kahing/goofys

    https://www.cuno.io/

  • winfsp

    Windows File System Proxy - FUSE for Windows

    Project mention: WinFsp · Windows File System Proxy | /r/patient_hackernews | 2023-06-16
  • rimraf

    A `rm -rf` util for nodejs

    Project mention: The Bun Shell | news.ycombinator.com | 2024-01-20

    And npmjs.com will block your IP if you do too many downloads in on day.

    Actually is says 86m a week here: https://www.npmjs.com/package/rimraf

  • google-drive-ocamlfuse

    FUSE filesystem over Google Drive

    Project mention: Obsidian didn't sync my files on Debian, any help? | /r/ObsidianMD | 2023-05-23

    I fixed the problem, it was due to the incorrect setup of the google drive. I followed this guide to set everything up from scratch and create the folder directly in Linux instead of constantly accessing the apparently "encrypted" cloud. If anyone ever runs into the same problem, I really hope this thread is helpful :D

  • dokany

    User mode file system library for windows with FUSE Wrapper

    Project mention: Projected File System | news.ycombinator.com | 2024-02-22

    It's not really the same though. A Projected File System copies the files from the backing store to somewhere on the local file system when requested and then performs IO normally on the local files.

    For an actual implementation of userspace filesystems on Windows see dokany: https://github.com/dokan-dev/dokany

  • goofys

    a high-performance, POSIX-ish Amazon S3 file system written in Go

    Project mention: Is Posix Outdated? | news.ycombinator.com | 2023-10-19

    The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).

    Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.

    So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that

    Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX

    That's why the blog post has the following links to POSIX-on-top-of-S3-objects :

    https://github.com/s3fs-fuse/s3fs-fuse

    https://github.com/kahing/goofys

    https://www.cuno.io/

  • react-native-fs

    Native filesystem access for react-native

    Project mention: react-native-tvos with expo-file-system? | /r/reactnative | 2023-12-09

    Maybe https://github.com/itinance/react-native-fs would work? Or does TVOS even have a filesystem API?

  • littlefs

    A little fail-safe filesystem designed for microcontrollers

    Project mention: LittleFS Design (CObW) – Combining advantages of COW and log-structures | news.ycombinator.com | 2024-01-25
  • GlusterFS

    Gluster Filesystem : Build your distributed storage in minutes

    Project mention: Tell HN: ZFS silent data corruption bugfix – my research results | news.ycombinator.com | 2023-12-06

    https://github.com/gluster/glusterfs/issues/894

    And apparently apart from modern coreutils using that, it is mostly gentoo users hitting the bugs in lseek.

  • mountpoint-s3

    A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

    Project mention: s3m: A CLI for streams of data in S3 buckets | /r/rust | 2023-12-05
  • xplr

    A hackable, minimal, fast TUI file explorer

  • mergerfs

    a featureful union filesystem

    Project mention: How do I use multiple hard drives on Kubuntu for steam? | /r/Kubuntu | 2023-12-10

    Have a look at mergerfs.

  • fselect

    Find files with SQL-like queries

  • gocryptfs

    Encrypted overlay filesystem written in Go

    Project mention: Syncthing: Untrusted Device Encryption | news.ycombinator.com | 2023-12-07

    I'm looking to improve my documents syncing setup. Currently I'm using owncloud, but that seems overkill for just files syncing and it requires maintenance, so I gave Syncthing a look. The "Untrusted device encryption" was not appealing to me because I'm not convinced by the security aspects yet, and also because it is in beta for now. I used gocryptfs [1] in the past and was quite happy with it, so I'm planning to use it on top of Syncthing to have files synced encrypted. As far as I have read this setup (Syncthing + gocryptfs) seems to be used by several people and has already been discussed by gocryptfs' author, who recommended a `-sharedstorage` flag for such use case [2]. Reading [3] I think gocryptfs is more suited for files syncing than cryfs. I'm aware that the metadata (file size, structure, …) of my files are not encrypted but that's a compromise I'm ready to make.

    I would be happy to hear about opinions about this approach.

    [1] https://nuetzlich.net/gocryptfs/

    [2] https://github.com/rfjakob/gocryptfs/issues/549#issuecomment...

    [3] https://www.cryfs.org/comparison

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-03-16.

Filesystem related posts

Index

What are some of the best open-source Filesystem projects? This list will help you:

Project Stars
1 fd 31,175
2 spacedrive 28,547
3 nnn 18,043
4 autojump 15,877
5 Flysystem 13,174
6 duf 12,168
7 chokidar 10,489
8 juicefs 9,675
9 fs-extra 9,332
10 s3fs-fuse 7,984
11 winfsp 6,467
12 rimraf 5,456
13 google-drive-ocamlfuse 5,334
14 dokany 5,015
15 goofys 4,995
16 react-native-fs 4,868
17 littlefs 4,701
18 GlusterFS 4,445
19 mountpoint-s3 3,946
20 xplr 3,881
21 mergerfs 3,803
22 fselect 3,772
23 gocryptfs 3,264
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com