Dedupfs Alternatives

Similar projects and alternatives to dedupfs

.NET Runtime

611 14,177 10.0 C# dedupfs VS .NET Runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
testssl.sh

43 7,667 8.7 Shell dedupfs VS testssl.sh

Testing TLS/SSL encryption anywhere on any port
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Samba

33 869 10.0 C dedupfs VS Samba

https://gitlab.com/samba-team/samba is the Official GitLab mirror of https://git.samba.org/samba.git -- Merge requests should be made on GitLab (not on GitHub) (by samba-team)
ssh-audit

21 3,138 8.6 Python dedupfs VS ssh-audit

SSH server & client security auditing (banner, key exchange, encryption, mac, compression, compatibility, security, etc) (by jtesta)
tarsnap

11 845 8.3 C dedupfs VS tarsnap

Command-line client code for Tarsnap.
yubikey-agent

15 2,575 0.0 Go dedupfs VS yubikey-agent

yubikey-agent is a seamless ssh-agent for YubiKeys.
tinyssh

8 1,389 5.0 C dedupfs VS tinyssh

TinySSH is small server (less than 100000 words of code)
SaaSHub

www.saashub.com featured

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
mfsbsd

5 473 1.9 Makefile dedupfs VS mfsbsd

mfsBSD

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better dedupfs alternative or higher similarity.

Suggest an alternative to dedupfs

dedupfs reviews and mentions

Posts with mentions or reviews of dedupfs. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-09-15.

FreeBSD SSH Hardening
9 projects | news.ycombinator.com | 15 Sep 2021

Is it possible to use tarsnap's deduplication code on my own server? We're setting up an ML dataset distribution box, and I was hoping to avoid storing e.g. imagenet as a tarball + untar'd (so that nginx can serve each photo individually) + imagenet in TFDS format.
https://github.com/xolox/dedupfs was the closest I found, but it has a lot of downsides.
Has anyone made an interface to tarsnap's tarball dedup code? A python wrapper around the block dedup code would be ideal, but I doubt it exists.
(Sorry for the random question -- I was just hoping for a standalone library along the lines of tarsnap's "filesystem block database" APIs. I thought about emailing this to you instead, but I'm crossing my fingers that some random HN'er might know. I'm sort of surprised that filesystems don't make it effortless. In fact, I delayed posting this for an hour to go research whether ZFS is the actual solution -- apparently "no, not unless you have specific brands of SSDs: https://www.truenas.com/community/resources/my-experiments-i..." which rules out my non-SSD 64TB Hetzner server. But like, dropbox solved this problem a decade ago -- isn't there something similar by now?)