cshatag
scorch
| cshatag | scorch | |
|---|---|---|
| 31 | 9 | |
| 217 | 184 | |
| - | - | |
| 3.4 | 0.0 | |
| about 1 year ago | about 1 year ago | |
| Go | Python | |
| MIT License | ISC License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cshatag
- Here is a Windows Powershell Script to Generate and Validate MD5 Hashes of Your Data.
- Best way to verify backup on linux?
- Redundancy and bit-rot protection on a single drive
- Those not on ZFS, etc. Do you hash your files?
- Best solution to prevent bitrot?
- Are external HDD stored offsite enough to back up my important data?
- What file system do you use for drives that go in cold storage?
- Has anyone ever had corruption/data loss with bit rot?
- How can I protect my drives against bit rot?
- What's the best value method to store 60TB of data and protect against data decay (bit rot)?
scorch
-
How do I ensure that I do not get a time-delayed ransomware attack?
The method I use is to run scorch every night to compute hashes for new files and check around 12% of old files for hash errors every night. Even if your backup is the same day as a ransomware attack, you will still catch it if the attack hits enough files for one to get randomly scrubbed. Also scorch is designed around making the hash database small and independent from the rest of the system, so you can automate copying it to a bunch of different places.
- Does this not exists? Checksum program...
-
ZFS or BTRFS for raid0 + backup server
Lastly, you could just point scorch (https://github.com/trapexit/scorch) at your drives and run it on a cron or systemd timer - just have the script alert you with an e-mail or whatever your preferred method is. Not ideal but probably less work than rebuilding two arrays because you don't like the format of error messages.
-
Embarking on my hoarding journey
If you really care, you can use something like scorch or file-digests to get the hashes of your files and just store that in a text file, recalculating monthly. No need to get fancy with it. Hell, write your own simple script that hashes, outputs to file, and checks previous versions.
-
Tool to add checksum to files on EXT4 and verify them.
Not exactly what you're looking for but close -> https://github.com/trapexit/scorch
-
Tool to compare file set against a list of hashes and import new/unique files
Scorch should fit the bill (https://github.com/trapexit/scorch)
- Generate hash for all files in all folders and subfolders on HDD
- Manual File Indexing
- Manual file indexing on my NAS
What are some alternatives?
winshatag - Detect silent data corruption on Windows using checksums in NTFS alternate data streams.
file-digests - 📐 A tool to check if there are any changes in your files by storing and later checking their digests/hashes (BLAKE2b512, SHA3-256, or SHA512-256).
Rsnapshot - a tool for backing up your data using rsync (if you want to get help, use https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss)
znapzend - zfs backup with remote capabilities and mbuffer integration.
BorgBackup - Deduplicating archiver with compression and authenticated encryption.
CalCorrupt - File corrupter using PyQt5
hashdeep
HashCheck - HashCheck Shell Extension for Windows with added SHA2, SHA3, and multithreading; originally from code.kliu.org
quickhash - Graphical cross platform data hashing tool for Linux, Windows and Mac
honst - Fixes your dataset according to your rules.
rsync - An open source utility that provides fast incremental file transfer. It also has useful features for backup and restore operations among many other use cases.
MultiPar - Parchive tool