reedsolomon
srep
reedsolomon | srep | |
---|---|---|
10 | 1 | |
1,803 | 0 | |
- | - | |
6.3 | 2.2 | |
about 1 month ago | over 2 years ago | |
Assembly | C | |
MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
reedsolomon
- Is this a viable strat to backup while still having some live access to relevant data?
- Tips for Long Term Data storage (20+ years).
- Adding redundancy records to data
- Go Implementation of Leopard-RS GF16
- Reedsolomon - Reed-solomon erasure coding in go
- Reedsolomon – Reed-Solomon Erasure Coding in Go
-
Don't Use RAR
Par2 is always an option, and RAR implements Reed-Solomon error correcting codes and there are many recent implementations of those: https://github.com/klauspost/reedsolomon.
-
Error correction question
Are you trying to implement something like this project: https://github.com/klauspost/reedsolomon
-
Reed-Solomon error recovery in RAID-6
This isn't a turn key utility, but it's relatively easy to call from Go. It allows you to set the number of data shards and parity shards, it's pretty fast. It's at
https://github.com/klauspost/reedsolomon
srep
-
Don't Use RAR
I typically don't make use of standard archive formats these days for my own file storage. If I want just pure maximum compression, I'll often use a long-range matcher like FreeArc's srep [1] or lrzip [2] combined with either fast-lzma2 [3] using a p7zip fork [4] for multithreading or use mcm [5] or zpaq.
However, my truly preferred way is using dwarfs [6], which features some really good deduplication and (by default) zstd compression while being mountable. Most of my files are highly compressed and easily accessible without needing to full decompress them. Admittedly, I don't make use of PAR2 or anything of the sort, but I could just do that the traditional way if I so wished.
[1]: https://github.com/Phantop/srep
What are some alternatives?
p7zip - A new p7zip fork with additional codecs and improvements (forked from https://sourceforge.net/projects/sevenzip/ AND https://sourceforge.net/projects/p7zip/).
dwarfs - A fast high compression read-only file system for Linux, Windows and macOS
fast-lzma2 - Fast LZMA2 Library
par2cmdline - Official repo for par2cmdline and libpar2
mcm - MCM file compressor
par3cmdline - Official repo for par3cmdline and par3lib
par2deep - Produce, verify and repair par2 files recursively.
NanaZip - The 7-Zip derivative intended for the modern Windows experience
Squirrel - An installation and update framework for Windows desktop apps