xxhash
xxh3
| xxhash | xxh3 | |
|---|---|---|
| 7 | 3 | |
| 1,690 | 380 | |
| - | - | |
| 2.8 | 2.7 | |
| 28 days ago | about 1 year ago | |
| Go | Go | |
| MIT License | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
xxhash
-
SIMD in Go
For my zstd port I use https://github.com/cespare/xxhash - which has arm64/amd64 assembly. The point isn't to compare against Go code. The point is to compare against assembly. It is IMO close to pointless to write intrinsics, if it is slower than assembly - you might as well write assembly from the beginning.
-
GO tools for inspecting package usage
It would be nice to if there a cli tool built into go tooling that allows us to query the golang proxy where i can find all packages using "github.com/cespare/xxhash/v2" sorted by the highest number of "imported by".
-
Portal: a CLI file transfer utility from any computer to another
Croc uses https://github.com/cespare/xxhash, which happens to be used by CNCF Prometheus and InfuxDB.
-
HaxMap, a concurrent hashmap faster and more memory-efficient than golang's sync.Map
Nopes, the hashing algorithm was exclusively meant for 64 bit archs https://github.com/cespare/xxhash hence it will show invalid results on any 32 bit architectures.
-
Show Golang: dskDitto - Small go utility to find file duplicates rapidly
Have you considered using xxhash?
xxh3
-
SIMD in Go
Not sure what you are thinking about with regard to parallel. Maybe you are thinking of xxhash 3. Both operate so close to memory speed that doing parallel blocks and merging them will probably always be slower.
-
Can I concatenate multiple non-crypto hash functions to reduce collision?
xxhash3 can supply hashes up to 128 bits and supports seeds and has pretty good speed on short inputs.
-
Fastest way to encode []int8 to bytes hash ?
If you can live with 16 bytes output and non cryptographic quality xxhash 3 you can use Hash128(values).Bytes().
What are some alternatives?
sonic - A blazingly fast JSON serializing & deserializing library
sha256-simd - Accelerate SHA256 computations in pure Go using AVX512, SHA Extensions for x86 and ARM64 for ARM. On AVX512 it provides an up to 8x improvement (over 3 GB/s per core). SHA Extensions give a performance boost of close to 4x over native.
haxmap - Fastest and most memory efficient golang concurrent hashmap
highwayhash - Native Go version of HighwayHash with optimized assembly implementations on Intel and ARM. Able to process over 10 GB/sec on a single core on Intel CPUs - https://en.wikipedia.org/wiki/HighwayHash
xxHash - Pure Go implementation of xxHash (32 and 64 bits versions)
BLAKE3 - the official Rust and C implementations of the BLAKE3 cryptographic hash function
hashmap - A Golang lock-free thread-safe HashMap optimized for fastest read access.
go-highway - Go implementation of Google's HighwayHash
intrinsics - Experiment with Go intrinsics (NOT USABLE)
avo - Generate x86 Assembly with Go