C++ Filesystem

Open-source C++ projects categorized as Filesystem

Top 23 C++ Filesystem Projects

  • s3fs-fuse

    FUSE-based file system backed by Amazon S3

    Project mention: Is Posix Outdated? | news.ycombinator.com | 2023-10-19

    The author needs to ask themselves: in this cloud technology stack, is there POSIX involved somewhere lower down, where I can't access it? The answer is, of course, "yes". The sort of cloud storage systems described all run on top of POSIX APIs. They provide convenience (cost efficiency is more debatable) compared to the POSIX alternative, but that's because they exist at an entirely different conceptual layer (hence the presence of POSIX anyway, just buried).

    Your point about surfacing a POSIX that's actually there but hidden and thus visible to low-level Amazon employees building the S3 service which makes it invisible to S3 end customers is true but isn't the the point of the article. The author is saying there are motivations for a POSIX-like api visible also the end user.

    So your explanation of stack looks like 2 layers: POSIX api <-- AWS S3 built on top of that

    Author's essay is actually talking about 3 layers: POSIX <-- AWS S3 <-- POSIX

    That's why the blog post has the following links to POSIX-on-top-of-S3-objects :

    https://github.com/s3fs-fuse/s3fs-fuse

    https://github.com/kahing/goofys

    https://www.cuno.io/

  • react-native-fs

    Native filesystem access for react-native

    Project mention: react-native-tvos with expo-file-system? | /r/reactnative | 2023-12-09

    Maybe https://github.com/itinance/react-native-fs would work? Or does TVOS even have a filesystem API?

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • mergerfs

    a featureful union filesystem

    Project mention: How do I use multiple hard drives on Kubuntu for steam? | /r/Kubuntu | 2023-12-10

    Have a look at mergerfs.

  • btfs

    A bittorrent filesystem based on FUSE.

  • cryfs

    Cryptographic filesystem for the cloud

    Project mention: Syncthing: Untrusted Device Encryption | news.ycombinator.com | 2023-12-07

    I know that cryfs[1] is resilient to at least the first of these, and possibly the second as well. I don't know if cryfs allows to modify the base directory while the filesystem is online, if it does then it might already be a better solution for syncthing, if you only care about Linux.

    On the flip side syncthing could incorporate cryfs's base directory format instead of their home-grown one.

    [1] https://www.cryfs.org/

  • apfs-fuse

    FUSE driver for APFS (Apple File System)

    Project mention: I used to work for apple | /r/computer | 2023-06-03

    OR to attempt to recover data from the old drive, you can use a USB and boot into a Linux Live instance, install apfs-fuse to mount the partition if it is not encrypted. Here's a tutorial to boot into Ubuntu Live. And here is a link to the github repository for apfs-fuse.

  • filesystem

    An implementation of C++17 std::filesystem for C++11 /C++14/C++17/C++20 on Windows, macOS, Linux and FreeBSD.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • dwarfs

    A fast high compression read-only file system for Linux, Windows and macOS

    Project mention: Help! Does anyone know how to install johncena141 games on linux? | /r/LinuxCrackSupport | 2023-07-01

    on a fresh install all you need is dwarfs https://github.com/mhx/dwarfs and libopenal1

  • securefs

    Filesystem in userspace (FUSE) with transparent authenticated encryption

  • io

    Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO (by tensorflow)

    Project mention: Has anyone gotten tensorflow_io to work on their M1 Mac? As far as I can tell there are no solutions. | /r/tensorflow | 2023-07-23

    Been stuck on this for days. The issue is mentioned in this year old thread, with multiple solutions that dont end up working. https://github.com/tensorflow/io/issues/1625 . If we're on Mac are we just SOL? Never encountered this type of problem before where you straight up cant work because your Mac is incompatible with the necessary software.

  • watcher

    Filesystem watcher. Works anywhere. Simple, efficient and friendly. (by e-dant)

  • sparsebundlefs

    FUSE filesystem for reading macOS sparse-bundle disk images

  • fatcat

    FAT filesystems explore, extract, repair, and forensic tool

  • hypergrep

    Recursively search directories for a regex pattern

    Project mention: Ugrep – a more powerful, ultra fast, user-friendly, compatible grep | news.ycombinator.com | 2023-12-30

    Another issue with Hyperscan is that if you enable HS_FLAG_UTF8[1], which hypergrep does[2,3], and then search invalid UTF-8, then the result is UB.

    > This flag instructs Hyperscan to treat the pattern as a sequence of UTF-8 characters. The results of scanning invalid UTF-8 sequences with a Hyperscan library that has been compiled with one or more patterns using this flag are undefined.

    That's another issue you'll need to grapple with if you use Hyperscan. PCRE2 used to have this issue[4], but they've since defined the semantics of searching invalid UTF-8 with Unicode mode enabled. ripgrep 14 uses that new mode, but I haven't updated that FAQ answer yet.

    [1]: https://intel.github.io/hyperscan/dev-reference/api_files.ht...

    [2]: https://github.com/p-ranav/hypergrep/blob/ee85b713aa84e0050a...

    [3]: https://github.com/p-ranav/hypergrep/blob/ee85b713aa84e0050a...

    [4]: https://github.com/BurntSushi/ripgrep/blob/master/FAQ.md#why...

  • fuse-archive

    FUSE file system for archives and compressed files (ZIP, RAR, 7Z, ISO, TGZ, XZ...)

  • mount-zip

    FUSE file system for ZIP archives

    Project mention: Nextcloud alternative with less file number overhead | /r/DataHoarder | 2023-07-03

    there's a project from Google called mount-zip where you can mount zips (and it actually works really well even with 1TB zips)

  • loggedfs

    LoggedFS - Filesystem monitoring with Fuse

  • 11Zip

    Dead simple zipping / unzipping C++ Lib

  • MaslOS

    Masl OS

    Project mention: Ported Doom to MaslOS | /r/itrunsdoom | 2023-04-17

    yes I got Doom running on my custom OS.

  • WinFsp-MemFs-Extended

    tmpfs for Windows / Fully dynamic RAM disk by extending WinFsp's memfs to be variable size and maximally resource efficient without compromising performance

    Project mention: Tmpfs for Windows / Memefs | news.ycombinator.com | 2023-12-04
  • psfiles

    A CLI tool to monitor file system activity of a Linux process

    Project mention: FLaNK Stack 26 February 2024 | dev.to | 2024-02-26
  • qsort

    Quick File Sorter: A quicker way to organize files for linux (by BiltuDas1)

    Project mention: GitHub - BiltuDas1/qsort: Quick File Sorter: A quicker way to organize files for linux | /r/linux | 2023-05-13
  • tff

    Terminal File Finder Written In C++

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-02-26.

C++ Filesystem related posts

Index

What are some of the best open-source Filesystem projects in C++? This list will help you:

Project Stars
1 s3fs-fuse 7,984
2 react-native-fs 4,868
3 mergerfs 3,803
4 btfs 3,128
5 cryfs 1,925
6 apfs-fuse 1,624
7 filesystem 1,259
8 dwarfs 1,244
9 securefs 689
10 io 687
11 watcher 625
12 sparsebundlefs 302
13 fatcat 283
14 hypergrep 163
15 fuse-archive 123
16 mount-zip 114
17 loggedfs 110
18 11Zip 86
19 MaslOS 85
20 WinFsp-MemFs-Extended 42
21 psfiles 39
22 qsort 19
23 tff 4
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com