|-||3 days ago|
|-||GNU General Public License v3.0 or later|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Using Materialize and Redpanda to Analyze Raspberry Pi Temperature Data
2 projects | dev.to | 13 Jan 2022
git clone https://github.com/bobbyiliev/mz-raspberry-pi-temperature.git
OctoSQL allows you to join data from different sources using SQL
13 projects | news.ycombinator.com | 14 Jul 2022
Definitely considering adding a server-mode with Postgres wire protocol compatibility.
It's tricky for the more dynamic/dataflow'y parts, as OctoSQL is able to give you a live updating output table (which Postgres wire protocol doesn't support), but I can go with a similar approach as Materialize does for those use cases - creating a live-updating materialized view that you can query from.
That said, for now I'm still concentrating on the overall local usage experienced and ergonomics, there's still much to improve there.
Convex vs. Firebase
7 projects | news.ycombinator.com | 21 Jun 2022
hi! sujay from convex here. I remember reading about your "reverse query engine" when we were getting started last year and really liking that framing of the broadcast problem here.
How we made data aggregation on PostgreSQL better and faster
4 projects | news.ycombinator.com | 21 Jun 2022
https://materialize.com/ is billed to be that. That behavior is not trivial to implement.
Why does dbt have so much hype/ metions in this subreddit?
1 project | reddit.com/r/dataengineering | 17 Jun 2022
Ha! Apparently I totally made that up—I meant https://materialize.com/
ReadySet Core: next-generation SQL caching, freely available
5 projects | news.ycombinator.com | 16 Jun 2022
Cache invalidation might no longer be a hard thing in Computer Science
1 project | news.ycombinator.com | 8 Jun 2022
Yep, cache invalidation is hard because you can't just cache /users/1/networkstatus as a function of the request itself; its underlying value is a complex function of values fetched from possibly dozens of tables and services, any of which could change at any time without any immediately discernable connection to User 1.
OP's response to this, in another comment, is: "Now going back to your example with complicated dependencies. Maybe TTL is a better solution. With many dependencies, any changes from the dependency list might trigger invalidation. At some point, just doing TTL, would be simpler."
But what if you actually do want your dependency list to trigger invalidation?
https://materialize.com/ is the closest thing I know of to a "solution" for this - it lets you build nested, realtime materialized views on top of streaming and non-streaming data, all with SQL syntax and Postgres wire compatibility, that fully recalculate and recache their results whenever any input changes, no matter how deep (based on https://timelydataflow.github.io/timely-dataflow/ from Microsoft Research).
You could either use the outputs of such a system as a cache, or weave together a cache invalidation signaling system that sends a stream of keys that need to be evicted from cache at any time, directly into a Kafka topic. And then, of course, this could plug into Meta's cache invalidation consensus system. But it's remarkably disingenuous for Meta to pretend that the dependency side of this problem is trivial or can be solved by TTLs alone.
DeWitt Clause, or Can You Benchmark %DATABASE% and Get Away With It
21 projects | dev.to | 2 Jun 2022
Materialize (licensed under BSL, not OSI-approved)
Materialize - The fastest way to build the fastest data products
1 project | reddit.com/r/github_trends | 30 May 2022
cargo-machete: Remove unused dependencies with this one weird trick!
1 project | reddit.com/r/rust | 27 Apr 2022
This is great, thank you so much! I just used it to clean up our workspace and was shocked from how many it found (I had already ran cargo-udeps in the past) https://github.com/MaterializeInc/materialize/pull/12099
Serverless Node.js URL Shortener App powered by Upstash Kafka and Materialize
3 projects | dev.to | 15 Apr 2022
The app is powered by Cloudflare Workers and Upstash Redis for storing data and Kafka for storing the click events along with Materialize for real-time data analytics.
What are some alternatives?
ClickHouse - ClickHouse® is a free analytics DBMS for big data
risingwave - RisingWave: the next-generation streaming database in the cloud.
rust-kafka-101 - Getting started with Rust and Kafka
openpilot - openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for over 150 supported car makes and models.
scryer-prolog - A modern Prolog implementation written mostly in Rust.
dbt-expectations - Port(ish) of Great Expectations to dbt test macros
partiql-lang-rust - PartiQL libraries and tools in Rust.
zeebe - Distributed Workflow Engine for Microservices Orchestration
kubesql - Experimental tool to query K8s API using plain SQL
delta-rs - A native Rust library for Delta Lake, with bindings into Python and Ruby.
timely-dataflow - A modular implementation of timely dataflow in Rust
roapi - Create full-fledged APIs for slowly moving datasets without writing a single line of code.