Rust streaming-data Projects
-
readyset
ReadySet is a lightweight SQL caching engine written in Rust that helps developers enhance the performance and scalability of existing applications.
hi! sujay from convex here. I remember reading about your "reverse query engine" when we were getting started last year and really liking that framing of the broadcast problem here.
as james mentions, we entirely re-run the javascript function whenever we detect any of its inputs change. incrementality at this layer would be very difficult, since we're dealing with a general purpose programming language. also, since we fully sandbox and determinize these javascript "queries," the majority of the cost is in accessing the database.
eventually, I'd like to explore "reverse query execution" on the boundary between javascript and the underlying data using an approach like differential dataflow [1]. the materialize folks [2] have made a lot of progress applying it for OLAP and readyset [3] is using similar techniques for OLTP.
Rust streaming-data related posts
- Serverless Node.js URL Shortener App powered by Upstash Kafka and Materialize
- How to manage your Materialize migrations with Laravel Zero?
- Decoupled Microservices Architecture with Materialize
- How to connect Laravel to Materialize and build a live dashboard?
- How to use dbt with Materialize and Redpanda
Index
Project | Stars | |
---|---|---|
1 | readyset | 1,025 |
Are you hiring? Post a new remote job listing for free.