filedriller
FileTrove
| filedriller | FileTrove | |
|---|---|---|
| 2 | 3 | |
| 14 | 21 | |
| - | - | |
| 3.6 | 8.9 | |
| 4 months ago | 2 days ago | |
| Go | Go | |
| GNU General Public License v3.0 or later | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
filedriller
-
FileTrove: A file indexer
The 5.3GB is an old value in the documentation from the web site, I have to correct that, thanks. I got it down to 3.5GB. However, you are right, this is a huge number of SHA1s. I once had another tool, filedriller (https://github.com/steffenfritz/filedriller), that I presented at iPres and used a Redis db for that with less than 1GB. Redis handles that better than Bolt. On the other hand, NIST changed the NSRL format and range (in the sense of years and systems) of the RDS sets. So I think the overhead is not too big. We have over 62.500.000 hashes in it. I think that's ok :)
- Filedriller: Identify file types using siegfried and the NSRL
FileTrove
-
FileTrove: A file indexer
There is a web page for documentation: https://filetrove.fritz.wtf
-
BBolt: Huge database file from SHA1
I am creating a BBolt database file from a text file. The text file contains SHA1 strings, one per line. The code to create it can be found here: https://github.com/steffenfritz/FileTrove/blob/main/cmd/admftrove/main.go and here: https://github.com/steffenfritz/FileTrove/blob/main/nsrl.go
What are some alternatives?
authelia - The Single Sign-On Multi-Factor portal for web apps
library - 70+ CLI tools to build, browse, and blend your media library. An index for your archive.
mimesniffer - A MIME type sniffer for Go.
puremagic - Pure python implementation of identifying files based off their magic numbers
Caddy - Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS
odict - A blazingly-fast, offline-first format and toolchain for lexical data 📖
trivy - Find vulnerabilities, misconfigurations, secrets, SBOM in containers, Kubernetes, code repositories, clouds and more
Lean and Mean Docker containers - Slim(toolkit): Don't change anything in your container image and minify it by up to 30x (and for compiled languages even more) making it secure too! (free and open source)
klog - Command line tool for time tracking in a human-readable, plain-text file format.