Scylla – Real-Time Big Data Database

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • Scylla

    NoSQL data store using the seastar framework, compatible with Apache Cassandra

    I posted this because I'm interested to hear from anyone using it - how has it worked out for you?

    I note it's written in C++ which is a bit of a surprise - I'd expected Rust or Golang.

    Interesting as well is is AGPL - licensing is always contentious:

    https://github.com/scylladb/scylla/blob/master/LICENSE.AGPL

  • charybdefs

    ScyllaDB fault injection filesystem

    Charybdefs is our fault injection filesystem. Though it's based in Thrift, the ol' API that predated CQL.

    https://github.com/scylladb/charybdefs

    More modern is Project Circe, our efforts to make Scylla into an even more monstrous database:

    https://www.scylladb.com/2021/01/12/making-scylla-a-monstrou...

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • noria

    Fast web applications through dynamic, partially-stateful dataflow

    I always love your take even if I don't agree, SpaceCurve was a phenomenal system, one of the most pragmatic, high performance, easy to use MPP database systems I have ever used. We never met btw, was just a user.

    But I think you are wrong about Rust not having the right machinery for making high performance dbs. Two examples are Noria and Materialize

    https://github.com/mit-pdos/noria

    and it its 50k lines, in the immediate codebase, there are 40 uses of unsafe.

    In Materialize's 125k of Rust, there are 76 direct uses of unsafe.

    https://github.com/MaterializeInc/materialize

  • materialize

    The data warehouse for operational workloads. (by MaterializeInc)

    I always love your take even if I don't agree, SpaceCurve was a phenomenal system, one of the most pragmatic, high performance, easy to use MPP database systems I have ever used. We never met btw, was just a user.

    But I think you are wrong about Rust not having the right machinery for making high performance dbs. Two examples are Noria and Materialize

    https://github.com/mit-pdos/noria

    and it its 50k lines, in the immediate codebase, there are 40 uses of unsafe.

    In Materialize's 125k of Rust, there are 76 direct uses of unsafe.

    https://github.com/MaterializeInc/materialize

  • intellij-plugins

    Open-source plugins included in the distribution of IntelliJ IDEA Ultimate and other IDEs based on the IntelliJ Platform

    To also provide some constructive feedback:

    A good point of comparison is this website: https://www.jetbrains.com/idea/

    It's also a product targetted at technical people, including people working at startups and also large enterprise.

    No popups.

    When you click the community edition download link -- bam -- it is immediately downloading! No form to fill in.

    I don't even use their tools much any more, except for the Rust plugin. Nonetheless, I read through their "what's new" release notes, even for Java, because it is so well presented: https://www.jetbrains.com/idea/whatsnew/

    I don't have to sit through an hour-long YouTube video watching some guy introducing some other guy I don't care about for five minutes. https://knowyourmeme.com/memes/the-wadsworth-constant

    Instead they have GIFs showing short, to-the-point snippets of exactly what each feature does. Note that these don't animate by default! You have to click them to play the clip. I love that. They're helpful without being distracting while I'm reading nearby text.

    It also gives you an idea of what the product looks like in actual use.

    You have no idea how much crap people wade through to find this! I often spend hours googling terms like "Product X Screenshot", "Product X real-world", "Product X tutorial" in the futile attempt to just find out what the heck to expect. Is it a green-screen terminal app kept alive like some sort of crime against nature? Is it a web application? Does it come with a Windows-only GUI? If so, is it at least a usable one? Does it have command-line tools? PowerShell? Tab-complete?

    You go to a site like JetBrains, and you see exactly that! Real-world code being manipulated, showing you the product in all its glory.

    So show this! Show ScyllaDB doing something. Don't just talk about how it's 47% more snazzy than a competing product I haven't used.

    Show it doing a scheme change nearly instantly on a terabyte of data, or whatever. But show the product, or I walk away until I find a website that isn't afraid of letting me see what they're selling...

  • Rudra

    Rust Memory Safety & Undefined Behavior Detection

    Not sure proves your point, but maybe doesn't disprove your point strongly enough. I am not qualified to argue from experience about how Rust is ideally suited in the ways you think it is not. But from everything I have seen, it can do a whole lot of what C++ is also good at. Rust safety is not all or nothing and a codebase could definitely prioritize ergonomics over correctness.

    Two things that I saw in the last couple weeks that might start to sway you.

    https://github.com/sslab-gatech/Rudra#readme

    GhostCell: Separating Permissions from Data in Rust

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts