Our great sponsors
-
sanoid
These are policy-driven snapshot management and replication tools which use OpenZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.)
-
linux
Kernel source tree for Raspberry Pi-provided kernel builds. Issues unrelated to the linux kernel should be posted on the community forum at https://forums.raspberrypi.com/ (by raspberrypi)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
As far as performance, it frankly doesn't need much. It needs to store data securely, and slowly serve up files on occasion. Data on devices that really matters will get backed up in an automated way to them. The idea is to be robust, not to be speedy. Finally I want them to be able to send/receive between nodes. (Again, if you haven't checked out sanoid and syncoid, give them a look. We use them at work and they're awesome. I'm thinking I'll likely set up an OpenVPN or WireGuard server for the remote machines to connect to, so no pi's are exposed directly to the internet. Also, remote machines can be basically zero-config once they are connected to a lan with internet access.)
2) Unreliable USB-SATA, even if you can live without TRIM, and use spinning rust drives, the adapters I've tested suffer from USB resets under heavy load. (Large data transfers approaching Gigabit speeds. I can't tell if this is faulty hardware, or USB driver bugs. Workarounds include disable UAS and using usb-storage drivers..but in my experience sometimes even that suffers from the USB resets
One last thing, don't try running swap on the ZFS until this is fixed