-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
library
70+ CLI tools to build, browse, and blend your media library. An index for your archive. (by chapmanjacobd)
The most recent version, documentation and the source code can be found on Github: https://github.com/steffenfritz/FileTrove
The 5.3GB is an old value in the documentation from the web site, I have to correct that, thanks. I got it down to 3.5GB. However, you are right, this is a huge number of SHA1s. I once had another tool, filedriller (https://github.com/steffenfritz/filedriller), that I presented at iPres and used a Redis db for that with less than 1GB. Redis handles that better than Bolt. On the other hand, NIST changed the NSRL format and range (in the sense of years and systems) of the RDS sets. So I think the overhead is not too big. We have over 62.500.000 hashes in it. I think that's ok :)
My tool is focused on media and it has a few different scanning modes. It only uses exiftool with fsadd --image, ffprobe with either fsadd --video or fsadd --audio, and filetype via magic numbers using puremagic.
okay https://github.com/chapmanjacobd/library