Xorfilter Alternatives
Similar projects and alternatives to xorfilter
-
hackernews-button
Privacy-preserving Firefox extension linking to Hacker News discussion; built with Bloom filters and WebAssembly
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
xorfilter reviews and mentions
-
Show HN: Privacy-preserving browser extension linking to HN discussion
> Rather than determining if the current site has been submitted by querying the Firebase/Algolia APIs with every page you visit, the extension contains regularly-updating Bloom filters for all submitted HN stories to preserve user privacy.
Nice!
I built a pi-hole esque stub dns-resolver that uses Bloom Filters generated from hostfiles (60 MiB, 5M entries --> 2 MiB with 1% false positives) and it worked like a charm. At some point, I also looked into Xor Filters which are apparently even lighter and faster but couldn't find a JavaScript implementation [0].
I; however, stopped using Bloom Filters because its immutability meant building it over and over again which was a pain. Inverted Bloom Filters might have been useful since they can be updated in-place [1]. Instead, I went for storing hostnames in a Finite State Automata [2], which while not as compact as Bloom Filters, could be updated in-place, are deterministic, and faster. Likely, not a fit for your use-case however.
PinSketches might be a fit for accomplishing efficient set reconciliation.
[0] https://github.com/FastFilter/xorfilter#implementations-of-x...
[1] https://www.youtube.com/watch?v=eIs9nJ-JFvA
[2] http://stevehanov.ca/blog/?id=115
[3] https://github.com/sipa/minisketch
Stats
FastFilter/xorfilter is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of xorfilter is Go.
Popular Comparisons
Sponsored