dskDitto
Super fast duplicate file finder written in Golang. (by jdefrancesco)
xxhash
A Go implementation of the 64-bit xxHash algorithm (XXH64) (by cespare)
Our great sponsors
| dskDitto | xxhash | |
|---|---|---|
| 3 | 7 | |
| 13 | 1,683 | |
| - | - | |
| 5.8 | 2.8 | |
| 3 months ago | 19 days ago | |
| Go | Go | |
| Apache License 2.0 | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dskDitto
Posts with mentions or reviews of dskDitto.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-12-16.
-
Spawn multiple go routines, get the results back, in order of goroutine spawn...
Check out how I implemented my disk cleaner tool dskDitto. It might have the design pattern you’re looking for. Here is the link: https://github.com/jdefrancesco/dskDitto
-
Looking for ideas for side projects! (CPU Arch, RTL design, embedded/OS, firmware)
@OP I am working on my own x86 kernel from scratch if you’d like to help. Also I have a small utility dskDitto I’d like to actually continue developing: https://github.com/jdefrancesco/dskDitto
- Show Golang: dskDitto - Small go utility to find file duplicates rapidly
xxhash
Posts with mentions or reviews of xxhash.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-09.
-
SIMD in Go
For my zstd port I use https://github.com/cespare/xxhash - which has arm64/amd64 assembly. The point isn't to compare against Go code. The point is to compare against assembly. It is IMO close to pointless to write intrinsics, if it is slower than assembly - you might as well write assembly from the beginning.
-
GO tools for inspecting package usage
It would be nice to if there a cli tool built into go tooling that allows us to query the golang proxy where i can find all packages using "github.com/cespare/xxhash/v2" sorted by the highest number of "imported by".
-
Portal: a CLI file transfer utility from any computer to another
Croc uses https://github.com/cespare/xxhash, which happens to be used by CNCF Prometheus and InfuxDB.
-
HaxMap, a concurrent hashmap faster and more memory-efficient than golang's sync.Map
Nopes, the hashing algorithm was exclusively meant for 64 bit archs https://github.com/cespare/xxhash hence it will show invalid results on any 32 bit architectures.
-
Show Golang: dskDitto - Small go utility to find file duplicates rapidly
Have you considered using xxhash?
What are some alternatives?
When comparing dskDitto and xxhash you can also consider the following projects:
fdupes - FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
xxh3 - XXH3 algorithm in Go
duplikaatti - Remove duplicate files.
sonic - A blazingly fast JSON serializing & deserializing library
goneric - Go generic utilities
haxmap - Fastest and most memory efficient golang concurrent hashmap
goreleaser - Deliver Go binaries as fast and easily as possible
xxHash - Pure Go implementation of xxHash (32 and 64 bits versions)
Telegraf - The plugin-driven server agent for collecting & reporting metrics.
hashmap - A Golang lock-free thread-safe HashMap optimized for fastest read access.
intrinsics - Experiment with Go intrinsics (NOT USABLE)
avo - Generate x86 Assembly with Go