Collectd VS syncthing-android

https://collectd.org/ does the gathering (and writing to RRDTool database, if you so desire) part very well. Many plugins, easy to add more (just return one line of text)

Still need RRD viewere but that's not a huge stack

And it scales all the way to hundreds of hosts, as on top of network send/receive of stats it supports few other write formats aside from just RRD files.

Then you will have same problems but now you can bother manufacturer about it!

Also unless there is something horribly wrong about how often data is written, that SSD should run for ages.

We ran (for a test) consumer SSDs in busy ES cluster and they still lasted like 2 years just fine

The whole setup was a bit of overcomplicated too. RAID10 with 5+1 or 7+1 (yes Linux can do 7 drive RAID10) with hotspare woud've been entirely fine, easier, and most likely faster. You need backups anyway so ZFS doesn't give you much here, just extra CPU usage

Either way, monitoring wait per drive (easy way is to just plug collectd [1] into your monitoring stack, it is light and can monitor A TON of different metrics)

* [1]https://collectd.org/

Collectd pulls metrics from the OS, applications, logfiles and external devices for use in monitoring systems, finding performance bottlenecks and capacity planning. hombre_sabio explains, "Collectd is a tiny daemon that gathers information from a system. It enables mechanisms to collect and observe the values in different techniques. It is an open-source monitoring tool to retrieve and manage SNMP master agents."

Setting up php7.4-fpm (7.4.25-1+deb11u1) ... Job for php7.4-fpm.service failed because a fatal signal was delivered to the co ntrol process. See "systemctl status php7.4-fpm.service" and "journalctl -xe" for details. invoke-rc.d: initscript php7.4-fpm, action "start" failed. ● php7.4-fpm.service - The PHP 7.4 FastCGI Process Manager Loaded: loaded (/lib/systemd/system/php7.4-fpm.service; enabled; vendor pre set: enabled) Active: failed (Result: signal) since Mon 2021-12-27 23:53:51 GMT; 215ms ag o Docs: man:php-fpm7.4(8) Process: 2755 ExecStart=/usr/sbin/php-fpm7.4 --nodaemonize --fpm-config /etc /php/7.4/fpm/php-fpm.conf (code=killed, signal=ILL) Process: 2756 ExecStopPost=/usr/lib/php/php-fpm-socket-helper remove /run/ph p/php-fpm.sock /etc/php/7.4/fpm/pool.d/www.conf 74 (code=exited, status=0/SUCCES S) Main PID: 2755 (code=killed, signal=ILL) CPU: 281ms Dec 27 23:53:51 raspberrypi systemd[1]: Starting The PHP 7.4 FastCGI Process Man ager... Dec 27 23:53:51 raspberrypi systemd[1]: php7.4-fpm.service: Main process exited, code=killed, status=4/ILL Dec 27 23:53:51 raspberrypi systemd[1]: php7.4-fpm.service: Failed with result ' signal'. Dec 27 23:53:51 raspberrypi systemd[1]: Failed to start The PHP 7.4 FastCGI Proc ess Manager. dpkg: error processing package php7.4-fpm (--configure): installed php7.4-fpm package post-installation script subprocess returned error exit status 1 Setting up collectd (5.12.0-7.1) ... Job for collectd.service failed because a fatal signal was delivered to the cont rol process. See "systemctl status collectd.service" and "journalctl -xe" for details. invoke-rc.d: initscript collectd, action "restart" failed. ● collectd.service - Statistics collection and monitoring daemon Loaded: loaded (/lib/systemd/system/collectd.service; enabled; vendor prese t: enabled) Active: activating (auto-restart) (Result: signal) since Mon 2021-12-27 23: 53:52 GMT; 200ms ago Docs: man:collectd(1) man:collectd.conf(5) https://collectd.org Process: 2768 ExecStartPre=/usr/sbin/collectd -t (code=killed, signal=SEGV) CPU: 24ms dpkg: error processing package collectd (--configure): installed collectd package post-installation script subprocess returned error e xit status 1 dpkg: dependency problems prevent configuration of openmediavault: openmediavault depends on collectd; however: Package collectd is not configured yet. dpkg: error processing package openmediavault (--configure): dependency problems - leaving unconfigured Errors were encountered while processing: php7.4-fpm collectd openmediavault E: Sub-process /usr/bin/dpkg returned an error code (1)

For metrics storage I'm using a Graphite database and the graph UI itself is Grafana. To get these I'm using the Debian repos they supply with mostly off-the-shelf configs. For collecting metrics from the Pi to send to Graphite I use collectd. It has a lot of off-the-shelf plugins you can use to grab metrics like CPU usage & load average, network in/out, memory stats etc. The Minecraft-specific stuff you can get from configuring collectd plugins as well, like the tick lag graph I use the "tail" plugin to follow and parse the server log.

For monitoring, personally I use collectd and Collectd Graph Panel (sadly the latter is abandoned, but it still works fine)

I've got another one on topic of self-hosted file sharing:

- FileBrowser running in Docker (https://filebrowser.org/features)

- Syncthing running in another container (https://syncthing.net/)

Syncthing keeps the files on your PC, Mac, BSD systems updated, and FileBrowser can point to the share and supply a convenient web UI. It works for me, it's kind of like a local Dropbox-lite.

We use syncthing to share files between our machines. It avoids is having to use dropbox / OneDrive etc. You just choose a folder and it automatically syncs it in the background.

https://syncthing.net/

This very hn entries is bust contradicting your statement.

Also what about syncthing[1] (for recurrent/permanent sync) and croc[2] (for one time copies) ?

I have used both for a number of years already.

[1] https://syncthing.net/

[2] https://github.com/schollz/croc

I would use syncthing, which is open source at https://syncthing.net/.

After minimal setup, it just works(tm).

You have a normal directory in your filesystem, that is synced to the other peers (which you set up in the "minimal setup").

I have been using it for years, and it works well. It has no problems crossing os'es (i.e. windows -> linux, linux -> mac)

For windows I usually recommend https://github.com/canton7/SyncTrayzor, but vanilla syncthing works fine too (but don't try to mix them!)

Do consider Syncthing particularly if you are using Android. If using apple iOS you'd need the möbius sync client.

https://syncthing.net/

https://www.mobiussync.com/

One thing that it beats the cloud / centralized sync on is because the connection is direct between devices when the initial transfer is completed the file is completely there on the other device. With a cloud type of sync you do the transfer twice. I've seen stack up on large media or with the structure of cloud services pricing making it expensive depending on how your workflow is setup with inside and outside parties. For example, Dropbox deduction from all parties' storage limits not just the sharer.

You can also point Syncthing at a local sync of Dropbox or Google drive and then forward the files to other recipients from that for some purposes.

I think sync is a non-feature, as you can just ride on your existing solution.

For example, I use syncthing [1] with Obsidian to sync files off-cloud.

https://syncthing.net/

When I was 14 and just getting started, I used Notepad. Upgraded to Wordpad when I realized I loved putting italics in every other sentence, moved to Google Docs at around 25 when I started writing on my phone and wanted to sync with my computer, finally moved to Obsidian a few months ago (with Syncthing for syncing) when I decided I don't want to live in Google's house where they can burn my stuff down whenever they want.