fio
dokany
fio | dokany | |
---|---|---|
30 | 14 | |
4,889 | 5,076 | |
- | 0.9% | |
9.3 | 8.1 | |
5 days ago | about 2 months ago | |
C | C | |
GNU General Public License v3.0 only | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fio
- Flexible I/O Tester
-
Dire SMB speed with on PC to NAS
Assuming two systems use flash storage, network bandwidth is identical and it is configured the same way, there should be an issue within the PC, either system or storage drive. Check the system logs for errors and warning events related to data transfer from/to NAS. Try to benchmark the PCs' disks using fio to confirm they have similar performance. https://github.com/axboe/fio
- Test Linux I/O
-
Ask HN: What are some good resources for learning about low level disk/file IO?
Not specifically addressing your question, but when you get to the point of wanting to start doing some experiments you may find that 'fio' [1] is very handy.
[1] https://github.com/axboe/fio
-
KVM virtual machines on ZFS benchmarks
The dd is not a good benchmarking tool, you should use something like fio and probably tune it to use the ioengine most similar to your use case (eg. a database server will probably use some async IO interface). In your first example (with bs=1G) probably something (the guest OS, the qemu/kvm or the host OS) have split into smaller chunks anyway.
-
SSD Sequential Write Slowdowns
All linux tests are run with fio 3.32 (github) with future commit 03900b0bf8af625bb43b10f0627b3c5947c3ff79 manually applied.
-
Want to develop a GUI wrapper for a CLI tool. Trying to figure out the tools I need.
FIO: https://github.com/axboe/fio
-
Just write the f*****g parser.
Agree, I used flex/yacc to add an arithmetic expression evaluator to fio a few years back to allow simple math with some units in fio's job files, and for stuff like that, they're fine, but I wouldn't want to use them for a real language, the error handling is kind of a nightmare.
-
Could my SD Card be going bad, or could my Switch be?
Flexible I/O Tester (fio-3.33): https://github.com/axboe/fio
- Newly cloned SSD extremely slow on Linux
dokany
-
Projected File System
It's not really the same though. A Projected File System copies the files from the backing store to somewhere on the local file system when requested and then performs IO normally on the local files.
For an actual implementation of userspace filesystems on Windows see dokany: https://github.com/dokan-dev/dokany
-
Tutorial fo unlimited backup solution in these trying times with Backblaze, Raidrive and Dokany
Now that you are inside the Mirror folder with cmd, let’s start the Mirror function to attach a NAS or cloud folder as a local disk in order to get recognized by the BB client and be backed up. Write something like (read the dokany documentation for more details here): mirror.exe /r x:\ /l m , where x:\ should be the letter of the folder attached with Raidrive and m:\ the letter you want to assign to the new local disk.
-
Ask HN: What are some good resources for learning about low level disk/file IO?
I lead a project that included shipping a filesystem driver and a virtual disk on Windows.
What I did to learn the lower-level APIs, and perform initial testing on the driver, was write a "mirror" drive. The user-mode code pointed to a folder on disk, the driver made a virtual disk drive, and all reads and writes in the virtual disk drive went to the mirror folder.
On Windows, you can implement something like that using Dokany, Dokan, or Winfsp. On linux, there's the Fuse API. On Mac, there's MacFUSE.
Even if you don't do a "mirror" drive, understanding the callbacks that libraries like Dokany, Dokan, Winfsp, and Fuse do helps you understand how IO happens in the driver. Many IO methods provided in popular languages provide abstractions above what the OS does. (For example, the Windows kernel has no concept of the "Stream" that's in your C# program. The "Stream"'s Position property is purely a construct within the .Net framework.)
https://dokan-dev.github.io/
https://github.com/dokan-dev/dokany
https://osxfuse.github.io/
Another place to start is the OS's documentation itself. For example, you can start with Window's CreateFileA function. This typically is what gets called "under the hood" in most programming languages when you open or create a file: https://learn.microsoft.com/en-us/windows/win32/api/fileapi/...
-
Add USB connected phone as video source
You'll need this ressource installed in 1.X version to make it work : https://github.com/dokan-dev/dokany
-
Cheapest Way to Backup 40TB to Backblaze
Potentially no need to buy any hardware https://github.com/dokan-dev/dokany/wiki/Use-Mirror-example
- using back blaze personal? backing up nas?
- Error when trying to unlock any vault
- User mode file system library for windows with FUSE Wrapper
-
Cryptomator and Windows 11 - Experiences?
Yeah, I had an issue and had to downgrade the Dokan Library. I downloaded from here.
- ceph-dokan mount issues. Looking for the right place to ask questions.
What are some alternatives?
KDiskMark - A simple open-source disk benchmark tool for Linux distros
winfsp - Windows File System Proxy - FUSE for Windows
iperf - iperf3: A TCP, UDP, and SCTP network bandwidth measurement tool
Cryptomator - Multi-platform transparent client-side encryption of your files in the cloud
open-audit - Tracking and reporting for IT and related assets and configuration
reactos - A free Windows-compatible Operating System
rio - pure rust io_uring library, built on libc, thread & async friendly, misuse resistant
fuse-overlayfs - FUSE implementation for overlayfs
xNVMe - Portable and high-performance libraries and tools for NVMe devices as well as support for traditional/legacy storage devices/interfaces.
ifuse - A fuse filesystem to access the contents of iOS devices
act - Aerospike Certification Tool
udmabuf - User space mappable dma buffer device driver for Linux.