needle
FastHash
needle | FastHash | |
---|---|---|
3 | 3 | |
9 | 19 | |
- | - | |
0.0 | 6.7 | |
over 1 year ago | 5 months ago | |
Rust | C# | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
needle
-
FFmpeg 7.0 Released
I used this wrapper to implement an opening and ending detection tool for “fun” [1].
However, it seems that many programs opt to instead shell out to the ffmpeg CLI. I think it’s usually simpler than linking against the library and to avoid licensing issues. But there are some cases where the CLI doesn’t cut it.
[1] https://github.com/aksiksi/needle
-
How to get "skip intro" data from streaming sites or elsewhere?
I've developed a command line tool that can do this for you: https://github.com/aksiksi/needle. You can try it out by downloading the latest version for your platform from here: https://github.com/aksiksi/needle/releases/tag/v0.1.5.
-
Ask HN: What Are You Working On? (August 2022)
I’ve been working on needle[1], a CLI (and associated library) that can detect openings/intros and endings/credits across TV or anime episodes. It decodes audio, fingerprints it in chunks, and then compares chunks across files to find common sequences.
Right now, it works pretty well as a CLI app. However, the eventual goal is to wrap the library in a Jellyfin plugin (C#) that handles skipping intros. I think I’ve figured how to call a C library from C#, but there is a lot of work to do to actually get a functional plugin.
[1] https://github.com/aksiksi/needle
FastHash
-
The Smallest Hash Table
I've implemented your RecSplit method in my MPHF benchmark library (written in C#). The suite is not yet public, but I do want to say thank you for your fantastic method/code/paper. In my own rabbithole research, I stumbled upon several artifacts of your rabbithole trail. Most notably the stuff on StackOverflow, which helped my own research.
I've releaed a set og fast hash functions[1] to help gain an understanding of speed vs. quality. My biggest takeaway is that most generic hash functions can be specialized for integer inputs[2], which often reduce latency by quite a lot, making MPFH more attractive over simple iteration on small sets, as the overhead of hashing is considerably smaller.
[1] https://github.com/Genbox/FastHash
[2] https://github.com/Genbox/FastHash/blob/master/src/FastHash/...
-
The quick and practical “MSI” hash table
It was made (by Sanmayce) to optimize for instruction-level pipelining, and use the fact that modern CPUs have multiple execution ports. But due to those changes, it is not compatible with FNV1a anymore.
The trick of reading in stripes is employed by many of the fastest hashes. It is kinda funny to see how one author prefers a switch case over for loops, where others prefer while loops. The differences can sometimes have a big impact on what optimizations the compiler decides to use.
[1] https://github.com/Genbox/FastHash/blob/master/src/FastHash....
-
Ask HN: What Are You Working On? (August 2022)
At the moment I'm working on FastHash[1], a pet project of mine to port a few high-performance non-cryptographic hash functions to C#.
I'm also trying to build FastLinq, a value-by-reference Language Integrated Query (LINQ) optimized for high-performance scenarios. It is kind of a weird mix as LINQ in .NET is known for its high overhead.
Finally, I'm working on an Office setting synchronization application. I heard a podcast with Paul Thurrott complaining about the lack of sync solutions, so I thought I would do one for fun.
[1] https://github.com/Genbox/FastHash
What are some alternatives?
skeleton - A fully featured UI toolkit for Svelte + Tailwind. [Moved to: https://github.com/skeletonlabs/skeleton]
PicoPico - Pico-8 Player
open-recipe-project - Free, and open recipes for anyone to use
reframe - LeapTable 🦘- The fastest way to build, deploy, and manage LLM-powered agents on tabular data (dataframes, SQL tables and Spreadsheets). [Moved to: https://github.com/peterwnjenga/leaptable]
smhasher - Hash function quality and speed tests
oxide - Teach your PostgreSQL database how to speak MongoDB Wire Protocol
pyroscope-rs - Pyroscope Profiler for Rust. Profile your Rust applications.
aHash - aHash is a non-cryptographic hashing algorithm that uses the AES hardware instruction