Filesystem

Open-source projects categorized as Filesystem
Edit details
Language: + C + Rust + C++ + Go + TypeScript + JavaScript + Python + PHP + OCaml
Topics: Fuse Linux Rust Files CLI
The modern identity platform for B2B SaaS
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com
Sponsored

Top 23 Filesystem Open-Source Projects

  • fd

    A simple, fast and user-friendly alternative to 'find'

    • Project mention: Level Up Your Dev Workflow: Conquer Web Development with a Blazing Fast Neovim Setup (Part 1) | dev.to | 2024-03-16

    ripgrep: A super-fast file searcher. You can install it using your system's package manager (e.g., brew install ripgrep on macOS). fd: Another blazing-fast file finder. Installation instructions can be found here: https://github.com/sharkdp/fd

  • spacedrive

    Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.

    • Project mention: Interview with Mo Rajabi, co-founder and CEO of Noor | dev.to | 2024-04-18

    In the video, Mo talked about a few packages like Cidre and StrOm, and we referred to SpaceDrive.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • nnn

    n³ The unorthodox terminal file manager

    • Project mention: Directory navigation on Helix | /r/HelixEditor | 2023-12-06

    If you want a file full browser experience choose nnn: https://github.com/jarun/nnn . If you have a desktop file for Helix you can use the Gnome Files program to make all your programming language files open in Helix.

  • autojump

    A cd command that learns - easily navigate directories from the command line

    • Project mention: Autojump: A CD command that learns | news.ycombinator.com | 2024-03-30

  • Flysystem

    Abstraction for local and remote filesystems

    • Project mention: Open Source Projects You Can Lay Your Hand On | /r/XBScompany | 2023-12-06

    Flysystem is a PHP project with open source code that revolutionizes work with the filesystem. It offers a unified and straightforward approach by abstracting the differences between various file system types, including local and cloud-based ones. You can utilize a consistent API to integrate it into your projects seamlessly. You can use it in any web application that works with data storage to make it more efficient and user-friendly.

  • duf

    Disk Usage/Free Utility - a better 'df' alternative

    • Project mention: Go: What We Got Right, What We Got Wrong | news.ycombinator.com | 2024-01-04

    Not sure these are really popular, but I cannot resist advertising a few utilities written in Go that I regularly use in my daily workflow:

    - gdu: a NCDU clone, much faster on SSD mounts [1]

    - duf: a `df` clone with a nicer interface [2]

    - massren: a `vidir` clone (simpler to use but with fewer options) [3]

    - gotop: a `top` clone [4]

    - micro: a nice TUI editor [5]

    Building this kind of tools in Go makes sense, as the executables are statically compiled and are thus easy to install on remote servers.

    [1]: https://github.com/dundee/gdu

    [2]: https://github.com/muesli/duf

    [3]: https://github.com/laurent22/massren

    [4]: https://github.com/xxxserxxx/gotop

    [5]: https://github.com/zyedidia/micro

  • chokidar

    Minimal and efficient cross-platform file watching library

    • Project mention: The best testing setup for frontends, with Playwright and NextJS | dev.to | 2024-04-18

    For this, we'll use chokidar - more specifically the chokidar-cli package. chokidar is probably the most useful file watching library for the nodejs ecosystem and it will serve us well.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • juicefs

    JuiceFS is a distributed POSIX file system built on top of Redis and S3.

    • Project mention: South Korea's No.1 Search Engine Chose JuiceFS over Alluxio for AI Storage | dev.to | 2024-01-18

    Support for Kerberos keytab files

  • fs-extra

    Node.js: extra methods for the fs object like copy(), remove(), mkdirs()

    • Project mention: What are some of the best libraries you cannot work without? | /r/node | 2023-06-08

    I haven't seen fs-extra mentioned yet. For my work it involves a fair bit of reading/writing to the filesystem, so this makes it quite nice to deal with everything in an async way.

  • s3fs-fuse

    FUSE-based file system backed by Amazon S3

    • Project mention: Is Posix Outdated? | news.ycombinator.com | 2023-10-19

    The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).

    Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.

    So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that

    Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX

    That's why the blog post has the following links to POSIX-on-top-of-S3-objects :

    https://github.com/s3fs-fuse/s3fs-fuse

    https://github.com/kahing/goofys

    https://www.cuno.io/

  • winfsp

    Windows File System Proxy - FUSE for Windows

    • Project mention: WinFsp · Windows File System Proxy | /r/patient_hackernews | 2023-06-16

  • rimraf

    A `rm -rf` util for nodejs

    • Project mention: The Bun Shell | news.ycombinator.com | 2024-01-20

    And npmjs.com will block your IP if you do too many downloads in on day.

    Actually is says 86m a week here: https://www.npmjs.com/package/rimraf

  • google-drive-ocamlfuse

    FUSE filesystem over Google Drive

    • Project mention: Obsidian didn't sync my files on Debian, any help? | /r/ObsidianMD | 2023-05-23

    I fixed the problem, it was due to the incorrect setup of the google drive. I followed this guide to set everything up from scratch and create the folder directly in Linux instead of constantly accessing the apparently "encrypted" cloud. If anyone ever runs into the same problem, I really hope this thread is helpful :D

  • dokany

    User mode file system library for windows with FUSE Wrapper

    • Project mention: Projected File System | news.ycombinator.com | 2024-02-22

    It's not really the same though. A Projected File System copies the files from the backing store to somewhere on the local file system when requested and then performs IO normally on the local files.

    For an actual implementation of userspace filesystems on Windows see dokany: https://github.com/dokan-dev/dokany

  • goofys

    a high-performance, POSIX-ish Amazon S3 file system written in Go

    • Project mention: Is Posix Outdated? | news.ycombinator.com | 2023-10-19

    The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).

    Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.

    So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that

    Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX

    That's why the blog post has the following links to POSIX-on-top-of-S3-objects :

    https://github.com/s3fs-fuse/s3fs-fuse

    https://github.com/kahing/goofys

    https://www.cuno.io/

  • react-native-fs

    Native filesystem access for react-native

    • Project mention: react-native-tvos with expo-file-system? | /r/reactnative | 2023-12-09

    Maybe https://github.com/itinance/react-native-fs would work? Or does TVOS even have a filesystem API?

  • littlefs

    A little fail-safe filesystem designed for microcontrollers

    • Project mention: LittleFS Design (CObW) – Combining advantages of COW and log-structures | news.ycombinator.com | 2024-01-25

  • GlusterFS

    Gluster Filesystem : Build your distributed storage in minutes

    • Project mention: Tell HN: ZFS silent data corruption bugfix – my research results | news.ycombinator.com | 2023-12-06

    https://github.com/gluster/glusterfs/issues/894

    And apparently apart from modern coreutils using that, it is mostly gentoo users hitting the bugs in lseek.

  • mountpoint-s3

    A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

    • Project mention: Row Zero and Viewport Data Streaming | news.ycombinator.com | 2024-04-04

    ... or does "S3 file system" mean https://github.com/awslabs/mountpoint-s3 - a Rust project by AWS Labs that provides "a simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system" ?

  • xplr

    A hackable, minimal, fast TUI file explorer

  • mergerfs

    a featureful union filesystem

    • Project mention: How do I use multiple hard drives on Kubuntu for steam? | /r/Kubuntu | 2023-12-10

    Have a look at mergerfs.

  • fselect

    Find files with SQL-like queries

  • btfs

    A bittorrent filesystem based on FUSE.

    • Project mention: BTFS (BitTorrent Filesystem) | news.ycombinator.com | 2024-04-15

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Filesystem related posts

Index

What are some of the best open-source Filesystem projects? This list will help you:

Project Stars
1 fd 31,581
2 spacedrive 28,841
3 nnn 18,170
4 autojump 15,929
5 Flysystem 13,193
6 duf 12,249
7 chokidar 10,542
8 juicefs 9,791
9 fs-extra 9,347
10 s3fs-fuse 8,065
11 winfsp 6,560
12 rimraf 5,484
13 google-drive-ocamlfuse 5,357
14 dokany 5,060
15 goofys 5,031
16 react-native-fs 4,875
17 littlefs 4,764
18 GlusterFS 4,478
19 mountpoint-s3 4,003
20 xplr 3,928
21 mergerfs 3,868
22 fselect 3,803
23 btfs 3,809

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com