Building a High-Performance DB Buffer Pool in Zig W\ Io_uring New Fixed-Buffers

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • glommio

    Glommio is a thread-per-core crate that makes writing highly parallel asynchronous applications in a thread-per-core architecture easier for rustaceans.

  • FYI, Datadog has a Rust library for scheduling things to run thread-per-core with io_uring

    It'd be really useful for DB use cases:

    https://github.com/DataDog/glommio

  • bplustree

    Concurrent in-memory B+ Tree featuring optimistic lock coupling (by NeowayLabs)

  • Nifty. I started from the part of the Umbra presentation that initially struck me as most interesting -- the allocator portion (where he talks about repeatedly MMAP_ANONYMOUS on the same address range to reduce fragmentation, etc.) I stopped working when I started pondering the bits about pointer swizzling and how I'd make that work nicely in Rust, and never got as far as the pieces that would actually do the syncs to disk.

    I also came across another fellow who was inspired by the optimistic locking btree presented in LeanStore Umbra: https://github.com/NeowayLabs/bplustree

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • tigerbeetle

    The distributed financial transactions database designed for mission critical safety and performance.

  • https://discord.com/channels/605571803288698900/102362568632...

    Unfortunately for you we play more than enough Secret Hitler to know when it's time to yeet somebody out of the server right away. Can't wait to meet your new alt, maybe next time you will be able to post more than one message before I ban you :^)

    > They have a whole Discord server where they upvote and promote posts about Zig.

    We have more than one Zig Discord server where people share links, most of which do get posted on HN. If you think that would be enough to game HN, you really have no idea about anything you're talking about.

    > (The program won't even compile if you try to write 'hello world' with non-ASCII characters.)

    Wrong. https://zig.godbolt.org/z/dane73Wsr

    > Also the language is nowhere near a 1.0 release so companies are reluctant to use it in production environments.

    Uber is using zig cc:

    https://www.youtube.com/watch?v=SCj2J3HcEfc

    Bun is written in Zig and has VC funding:

    https://bun.sh/

    TigerBeetle is written in Zig and has VC funding

    https://tigerbeetle.com/

    Zig is not yet v1.0 and we do recommend caution to anybody that wants to invest in Zig, as they will have to deal with all the breakages that are expected in a healthy pre-1.0 language.

  • bun

    Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one

  • https://discord.com/channels/605571803288698900/102362568632...

    Unfortunately for you we play more than enough Secret Hitler to know when it's time to yeet somebody out of the server right away. Can't wait to meet your new alt, maybe next time you will be able to post more than one message before I ban you :^)

    > They have a whole Discord server where they upvote and promote posts about Zig.

    We have more than one Zig Discord server where people share links, most of which do get posted on HN. If you think that would be enough to game HN, you really have no idea about anything you're talking about.

    > (The program won't even compile if you try to write 'hello world' with non-ASCII characters.)

    Wrong. https://zig.godbolt.org/z/dane73Wsr

    > Also the language is nowhere near a 1.0 release so companies are reluctant to use it in production environments.

    Uber is using zig cc:

    https://www.youtube.com/watch?v=SCj2J3HcEfc

    Bun is written in Zig and has VC funding:

    https://bun.sh/

    TigerBeetle is written in Zig and has VC funding

    https://tigerbeetle.com/

    Zig is not yet v1.0 and we do recommend caution to anybody that wants to invest in Zig, as they will have to deal with all the breakages that are expected in a healthy pre-1.0 language.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts