Our great sponsors
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
hyperloglog
HyperLogLog with lots of sugar (Sparse, LogLog-Beta bias correction and TailCut space reduction) brought to you by Axiom
Is it possible to use a single fn to replace the beta4..beta18 fns[0], so that the polynomial expressions are generated at comptime instead of being hand-written?
[0] https://github.com/axiomhq/zig-hyperloglog/blob/main/src/bet...
[1] https://github.com/ClickHouse/ClickHouse/
What is often forgotten in designing a data structure for a cardinality estimator - is that it should work well not only for a few large states but also for a large number of small sets.
For example, in a query like follows:
SELECT URL, COUNT(DISTINCT UserID) FROM pageviews GROUP BY URL
I'm also very curious to know this. HyperLogLog is written in Go:
https://github.com/axiomhq/hyperloglog
I would expect V to be a more natural choice for a port than Zig.
Related posts
- We Built a 19 PiB Logging Platform with ClickHouse and Saved Millions
- 1 billion rows challenge in PostgreSQL and ClickHouse
- We Executed a Critical Supply Chain Attack on PyTorch
- Tell HN: Hacker News dataset on BigQuery hasn't been updated since Nov 2022
- Real-Time Data Enrichment and Analytics With RisingWave and ClickHouse