meow_hash
smhasher
| meow_hash | smhasher | |
|---|---|---|
| 13 | 1 | |
| 1,684 | 16 | |
| - | - | |
| 0.0 | 0.0 | |
| almost 2 years ago | about 3 years ago | |
| C++ | C | |
| zlib License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
meow_hash
-
Use fast data algorithms (2021)
I'm late on the reply but I was using xxhash for something similar, but found that Meow hash was faster for me. Feel free to benchmark, since I'm sure it could vary depending on CPU architecture.
- Meow Hash (2018)
- Meow Hash
-
Cryptanalysis of Meow Hash
for everyone who doesn't think highly of Casey Muratori (or at least the way he conducts himself online), the author of Meow Hash, took the criticism quite graciously:
https://twitter.com/cmuratori/status/1417546500083568641
https://github.com/cmuratori/meow_hash/issues/80
- Full 128-bit collision between two files in Meow Hash
-
Reading a file in parallel
Is a standardized hashing algorithm required? SHA256 takes several CPU cycle per byte, but there are several hashing algorithm utilizing AES-NI that gives them 15-16 bytes per cycles, which translates to tens of gigabytes per second on modern CPU. At least one of them has been ported to .NET Core, and from what I see properly calls AES primitives.
-
76% Faster CPython
MeowHash is the fastest non-cryptographic hash available online, and if it were used in CPython, which performs a hash for every fundamental operation in the language, then Python would be much faster.
-
New Bare Hash Map: 2X-3X Speedup over SOTA
Meow hash claims 3-4x faster hashing over this, still passes smhasher, and is a few years old. https://mollyrocket.com/meowhash
-
A Hashmap for the C Programming Language
Have you seen the meow hash implementation? Would that be suitable for this ?
smhasher
-
New Bare Hash Map: 2X-3X Speedup over SOTA
The meow 0.4 was faster at short keys, but failed at the smhasher "LongNeighborTest" [1]. However, doubling the AES rounds makes it pass that test. Two rounds is enough for full diffusion in AES [2]. I recently looked at computing 4 Meow keys per hash function [3], and found the speedup to be almost 2x in a microbench. That puts it in rare territory for hash speed.
[1] https://github.com/injinj/smhasher/
[2] Section 5.4 of Introduction to Cryptography by Trappe and Washington -- It can be shown that two rounds are sufficient to obtain full diffusion, namely, each of the 128 output bits depends on each of the 128 input bits.
[3] https://github.com/raitechnology/raikv/blob/3ce2b23e0d9853fe...
What are some alternatives?
xxHash - Extremely fast non-cryptographic hash algorithm
wyhash - The FASTEST QUALITY hash function, random number generators (PRNG) and hash map.
BLAKE3 - the official Rust and C implementations of the BLAKE3 cryptographic hash function
smhasher - Hash function quality and speed tests
hashbrown - Rust port of Google's SwissTable hash map
meow_hash.NET - Port of https://github.com/cmuratori/meow_hash to .NET Core
pHash - pHash - the open source perceptual hash library
smhasher - Automatically exported from code.google.com/p/smhasher
aHash - aHash is a non-cryptographic hashing algorithm that uses the AES hardware instruction
c-hashmap - A fast hash map/hash table (whatever you want to call it) for the C programming language.
highwayhash - Fast strong hash functions: SipHash/HighwayHash