Reading NFS at =25GB/s using FIO and libnfs

• iotrap

  1 3 0.0 C++

  IO throughput multiplier using multiple NFS connections

I did something similar (~2015) but using the kernel NFS client and having multiple mounts to the same volume using different IP addresses.

Using vectored IO and spreading across multiple connections greatly improved throughout. However, metadata operations cannot be parallelized easily without application side changes.

In more modern kernels, NFS supports ‘nconnect’ mount option to open multiple network connections for a single mount. I wonder if the approach of using libnfs for multiple connections is even required.

https://github.com/0xdky/iotrap

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• NFStash

  2 76 10.0 C

  NFS client CLI toolkit

The nice thing about NFS (v3) is that it's stateless, so you can just keep doing the same thing over and over. Messing around with metadata sucks but once you get the filehandle of the file that you want to read or write then you don't need it anymore.

I wrote a suite of tools that does all this and dumps the NFS transactions as JSON, maybe it can be useful:

https://github.com/mprovost/NFStash

Suggest a related project