duplikaatti
Remove duplicate files. (by raspi)
xxhash
A Go implementation of the 64-bit xxHash algorithm (XXH64) (by cespare)
| duplikaatti | xxhash | |
|---|---|---|
| 1 | 7 | |
| 15 | 1,696 | |
| - | - | |
| 0.0 | 2.8 | |
| over 2 years ago | 3 days ago | |
| Go | Go | |
| Apache License 2.0 | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
duplikaatti
Posts with mentions or reviews of duplikaatti.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-10-25.
-
Show Golang: dskDitto - Small go utility to find file duplicates rapidly
My duplikaatti dupe finder uses the following algo:
xxhash
Posts with mentions or reviews of xxhash.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-09.
-
SIMD in Go
For my zstd port I use https://github.com/cespare/xxhash - which has arm64/amd64 assembly. The point isn't to compare against Go code. The point is to compare against assembly. It is IMO close to pointless to write intrinsics, if it is slower than assembly - you might as well write assembly from the beginning.
-
GO tools for inspecting package usage
It would be nice to if there a cli tool built into go tooling that allows us to query the golang proxy where i can find all packages using "github.com/cespare/xxhash/v2" sorted by the highest number of "imported by".
-
Portal: a CLI file transfer utility from any computer to another
Croc uses https://github.com/cespare/xxhash, which happens to be used by CNCF Prometheus and InfuxDB.
-
HaxMap, a concurrent hashmap faster and more memory-efficient than golang's sync.Map
Nopes, the hashing algorithm was exclusively meant for 64 bit archs https://github.com/cespare/xxhash hence it will show invalid results on any 32 bit architectures.
-
Show Golang: dskDitto - Small go utility to find file duplicates rapidly
Have you considered using xxhash?
What are some alternatives?
When comparing duplikaatti and xxhash you can also consider the following projects:
fdupes - FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
xxh3 - XXH3 algorithm in Go
dskDitto - Super fast duplicate file finder written in Golang.
sonic - A blazingly fast JSON serializing & deserializing library
haxmap - Fastest and most memory efficient golang concurrent hashmap
xxHash - Pure Go implementation of xxHash (32 and 64 bits versions)
hashmap - A Golang lock-free thread-safe HashMap optimized for fastest read access.
intrinsics - Experiment with Go intrinsics (NOT USABLE)
avo - Generate x86 Assembly with Go
go-simd - SIMD implementation in Go