go-caskdb
fio
go-caskdb | fio | |
---|---|---|
5 | 30 | |
156 | 4,909 | |
- | - | |
4.1 | 9.3 | |
19 days ago | 4 days ago | |
Go | C | |
MIT License | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
go-caskdb
- Ask HN: What are some good resources for learning about low level disk/file IO?
-
Implementation of a relational database in go
shameless plug: here is my build your own kv store project in Go - https://github.com/avinassh/go-caskdb
-
The “Build Your Own Redis” Book Is Completed
I am a big fan of Build Your Own X educational projects. Recently, I released a Go version of my build your own KV Store project. I have set up this project in TDD fashion with the tests. So, you start with simple functions, pass the tests, and the difficulty level goes up. There are hints if you get stuck (e.g. link). When all the tests pass, you will have written a persistent key-value store.
go - https://github.com/avinassh/go-caskdb
python - https://github.com/avinassh/py-caskdb
- caskdb - a educational project to help you teach building a persistent key value store in Go
-
caskdb - a educational project to help you teach building a persistent key value store
link - https://github.com/avinassh/go-caskdb
fio
- Flexible I/O Tester
-
Dire SMB speed with on PC to NAS
Assuming two systems use flash storage, network bandwidth is identical and it is configured the same way, there should be an issue within the PC, either system or storage drive. Check the system logs for errors and warning events related to data transfer from/to NAS. Try to benchmark the PCs' disks using fio to confirm they have similar performance. https://github.com/axboe/fio
- Test Linux I/O
-
Ask HN: What are some good resources for learning about low level disk/file IO?
Not specifically addressing your question, but when you get to the point of wanting to start doing some experiments you may find that 'fio' [1] is very handy.
[1] https://github.com/axboe/fio
-
KVM virtual machines on ZFS benchmarks
The dd is not a good benchmarking tool, you should use something like fio and probably tune it to use the ioengine most similar to your use case (eg. a database server will probably use some async IO interface). In your first example (with bs=1G) probably something (the guest OS, the qemu/kvm or the host OS) have split into smaller chunks anyway.
-
SSD Sequential Write Slowdowns
All linux tests are run with fio 3.32 (github) with future commit 03900b0bf8af625bb43b10f0627b3c5947c3ff79 manually applied.
-
Want to develop a GUI wrapper for a CLI tool. Trying to figure out the tools I need.
FIO: https://github.com/axboe/fio
-
Just write the f*****g parser.
Agree, I used flex/yacc to add an arithmetic expression evaluator to fio a few years back to allow simple math with some units in fio's job files, and for stuff like that, they're fine, but I wouldn't want to use them for a real language, the error handling is kind of a nightmare.
-
Could my SD Card be going bad, or could my Switch be?
Flexible I/O Tester (fio-3.33): https://github.com/axboe/fio
- Newly cloned SSD extremely slow on Linux
What are some alternatives?
redi-s - A performant Redis server implemented in SwiftNIO.
KDiskMark - A simple open-source disk benchmark tool for Linux distros
build-your-own-x-in-rust
iperf - iperf3: A TCP, UDP, and SCTP network bandwidth measurement tool
reredis - Rewrite Redis in Rust.
open-audit - Tracking and reporting for IT and related assets and configuration
py-caskdb - (educational) build your own disk based KV store
rio - pure rust io_uring library, built on libc, thread & async friendly, misuse resistant
marmot - A distributed SQLite replicator built on top of NATS
xnvme - Portable and high-performance libraries and tools for NVMe devices as well as support for traditional/legacy storage devices/interfaces.
dokany - User mode file system library for windows with FUSE Wrapper
act - Aerospike Certification Tool