walkdir
loggedfs
walkdir | loggedfs | |
---|---|---|
5 | 2 | |
1,179 | 110 | |
- | - | |
4.3 | 0.0 | |
16 days ago | over 1 year ago | |
Rust | C++ | |
The Unlicense | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
walkdir
-
Project idea: port markdownlint to Rust
https://github.com/BurntSushi/walkdir for discovering markdown files
-
Blazingly fast file search library built in Rust 🔥
The API looks really nice! What is your vision for the project? How is it going to compare to (walkdir)[https://github.com/BurntSushi/walkdir] performance and feature-wise?
-
Git ls-files is Faster Than Fd and Find
> I believe that GNU find is slow because it is specifically written to allow arbitrary filesystem depth as opposed to "open file descriptor limit-limited depth".
I haven't benchmarked find specifically, but I believe the most common Rust library for the purpose, walkdir[1], also allows arbitrary file system recursion depth, and is extremely fast. It was fairly close to some "naive" limited depth code I wrote in C for the same purpose.
I'd be curious to see benchmarks of whether this actually makes a difference.
[1] https://github.com/BurntSushi/walkdir
-
Your favorite Rust CLI utility? I have my top 10 below.
It relies pretty heavily on the walkdir library from burntsushi so kudos to them!
-
Rust, musl and glibc in 2021
Although, I don't think FileType is the only problem. There's also Metadata, which I also had to re-roll: https://github.com/BurntSushi/walkdir/blob/1d7293a5a1ef548ce587a0b08abce5f21571a100/src/os/unix/stat.rs
loggedfs
-
What are the linux-audit and strace equivalents of the loggedfs file system monitoring commands?
Loggedfs is a userspace tool for monitoring file system access in a directory and after trying I realized that it impacts performance too much even though it doesn't require root permissions.
-
Git ls-files is Faster Than Fd and Find
I'm absolutely not an expert, but I feel like log-structured filesystems (https://en.wikipedia.org/wiki/Log-structured_file_system) are a natural fit for this kind of things: an index "just" has to read the latest written entries.
But if we're talking about the future, we're probably talking about btrfs and zfs, both of which have the internal machinery to give you a feed of "recently changed files" up to the beginning of the filesystem.
While writing this answer I stumbled upon https://github.com/rflament/loggedfs which is probably a very nice solution to this problem.
What are some alternatives?
parallel-disk-usage - Highly parallelized, blazing fast directory tree analyzer
cligen - Nim library to infer/generate command-line-interfaces / option / argument parsing; Docs at
zenith - Zenith - sort of like top or htop but with zoom-able charts, CPU, GPU, network, and disk usage
securefs - Filesystem in userspace (FUSE) with transparent authenticated encryption
cryfs - Cryptographic filesystem for the cloud
tools
mergerfs - a featureful union filesystem
hexyl - A command-line hex viewer
walk - Plan 9 style utilities to replace find(1)
s3fs-fuse - FUSE-based file system backed by Amazon S3