spdk
diskspd
spdk | diskspd | |
---|---|---|
6 | 14 | |
2,851 | 1,094 | |
1.8% | 1.4% | |
9.9 | 4.6 | |
6 days ago | about 1 month ago | |
C | C++ | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
spdk
-
calcuating IOPS
https://spdk.io will require you to load linux onto the server (livecd off a usb should be fine), but is essentially the most efficient way possible to do IO. Intel’s storage division used to use it to get the numbers they advertised with. When they loaded up a system with kioxia drives, Intel managed to hit 120 million IOPS in some of their testing.
- Storage performance development kit
- Win32 is the stable Linux userland ABI
- SPDK: Storage Performance Development Kit
-
ShellCheck: A static analysis tool for shell scripts
Since the project I work on (https://spdk.io) largely produces a set of executables as output, it was most natural to write the tests in bash. There's one top level bash script that kicks off the full suite of tests and thousands and thousands of lines of tests all written as bash scripts stringing together calls to these executables.
One of these tests is to run shellcheck against all of the scripts in the repo. We don't allow any modifications to scripts without shellcheck giving them the green light now. The quality of our tests has increased dramatically since this was instituted - it's a really great tool.
-
Achieving 11M IOPS and 66 GB/S IO on a Single ThreadRipper Workstation
FYI SPDK doesn't strictly require the IOMMU be enabled. See https://spdk.io/doc/system_configuration.html There's also a new experimental interrupt mode (not for everything) finding some valuable use cases in SPDK, see https://github.com/spdk/spdk/blob/master/CHANGELOG.md and feel free to jump on the SPDK slack channel or email list for more info on either of these https://spdk.io/community/
diskspd
- DiskSpd – Storage Performance Tool from the Windows Server Engineering Team
- calcuating IOPS
-
Windows Server 2016 running super slow
Make stress test using diskpsd or fio https://fio.readthedocs.io/en/latest/fio\_doc.html https://github.com/microsoft/diskspd A good reference to the benchmark process. https://www.hyper-v.io/whos-got-bigger-balls-testing-nfs-vs-iscsi-performance-part-3-test-results/3 sata, 4 TB haed disks.
- HyperV Host Storage Performance Issue - PCI SSD Mirror results 845MBs Read and 633MBs Write - Guest VM 162MB Read 57MB Write
-
ESXi Hard disk configuration
Am I right that 480 X 4 = 1920 GB of usable space? Thus, the second option gives you more disk space. Regarding performance, any configuration should fit your needs. Otherwise, you can always do some benchmarks. For Windows VMs use diskspd (https://github.com/microsoft/diskspd) and fio for Linux (https://www.starwindsoftware.com/blog/storage-performance-tester-vmware-fling)
- Anyone know of any good disk exercising software?
-
Why is this External so slow? - Seagate OneTouch 5TB HDD
Benchmark the disk performance using https://github.com/microsoft/diskspd. This post can be used as a reference. https://www.hyper-v.io/whos-got-bigger-balls-testing-nfs-vs-iscsi-performance-part-3-test-results/
-
All flash RAID, 111TB (32 x SAS 3.84TB SSDs)
Could you also try with diskspd? To create larger 128GB file using cmd console with
- E-Series Slow compared to old EqualLogic. Any tips?
- AFF A200 Performance
What are some alternatives?
KVell - KVell: the Design and Implementation of a Fast Persistent Key-Value Store
shellharden - The corrective bash syntax highlighter
chia-blockchain - Chia blockchain python implementation (full node, farmer, harvester, timelord, and wallet)
static-analysis - ⚙️ A curated list of static analysis (SAST) tools and linters for all programming languages, config files, build tools, and more. The focus is on tools which improve code quality.
hadolint - Dockerfile linter, validate inline bash, written in Haskell
shunit2 - shUnit2 is a xUnit based unit test framework for Bourne based shell scripts.
sh - A shell parser, formatter, and interpreter with bash support; includes shfmt
shellcheck-repl - Validation of Shell Commands Before Evaluation
find-sec-bugs - The SpotBugs plugin for security audits of Java web applications and Android applications. (Also work with Kotlin, Groovy and Scala projects)