Segcache: A memory-efficient and scalable key-value cache for small objects [pdf]

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

InfluxDB - Purpose built for real-time analytics at any scale.
InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • cache-trace

    A collection of Twitter's anonymized production cache traces.

    I wonder if dormando who sometimes comes around would care to run memcache with the same traces as are used in this paper, which are available at https://github.com/twitter/cache-trace. I'm not sure I care about a cache that can scale to 24 cores, as in my experience I usually end up with hundreds of caches each with a few cores rather than fewer, bigger cache servers, but it still would be interesting to see what memcached can do.

  • InfluxDB

    Purpose built for real-time analytics at any scale. InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards.

    InfluxDB logo
  • Segcache

  • xxHash

    Extremely fast non-cryptographic hash algorithm

    According to https://github.com/Cyan4973/xxHash, the best hash function can only do 100s M hashes per second, how can a local cache run at such throughput? I assume when measuring cache throughput, one need to calculate hash, look up, (maybe compare keys), and copy the data.

  • Caffeine

    A high performance caching library for Java

    A multi-threaded benchmark of a cache should be fully populated and use a scrambled Zipfian distribution. This emulates hot/cold entries and highlights the areas of contention (locks, CASes, etc). A lock-free read benefits thanks to cpu cache efficiency causing super linear growth.

    This shows if the implementation could be a bottleneck and scales well enough, after which the hit rate and other factors are more important than raw throughput. I would rather sacrifice a few nanos on a read than suffer much lower hit rates or have long pauses on a write due to eviction inefficiencies.

    [1] https://github.com/ben-manes/caffeine/wiki/Benchmarks#read-1...

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Day 64: Implementing a basic Bloom Filter Using Java BitSet api

    1 project | dev.to | 30 Dec 2022
  • Closed-addressing hashtables implementation

    2 projects | /r/C_Programming | 22 Dec 2022
  • Does the checksum algorithm crc32c-intel support AMD Ryzen series 3000 or newer?

    1 project | /r/btrfs | 12 Nov 2022
  • BLAKE2: “Harder, Better, Faster, Stronger” Than MD5 (2014)

    1 project | news.ycombinator.com | 23 Jan 2022
  • Better way to get a random 64 bit integer?

    1 project | /r/C_Programming | 6 Aug 2021

Did you konow that C is
the 7th most popular programming language
based on number of metions?