[Need inspiration] Building the control plane of a search engine (Quickwit)

• quickwit

  64 5,995 9.8 Rust

  Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.

  

For those who don't know yet the project, Quickwit is an OSS search engine for bigdata and more specifically for logs and traces.

• fluvio

  26 2,624 9.6 Rust

  Lean and mean distributed stream processing system written in rust and web assembly.

  

For now I have only fluvio on my inspiring projects list, do you have any other projects to recommend? Or some nice technical blog posts?

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• openraft

  2 1,201 9.4 Rust

  rust raft with improvements

  

I was reading through the code of databend: https://databend.rs/ It's a "wrapper" over datafusion and does a lot of similar things to Quickwit. And yeah, to drive the index cluster they rely on https://github.com/datafuselabs/openraft && https://github.com/datafuselabs/opendal. I'd be interested about you thoughts on the project if you've already heard about it too.

• opendal

  10 2,822 9.9 Rust

  Apache OpenDAL: access data freely.

  

I was reading through the code of databend: https://databend.rs/ It's a "wrapper" over datafusion and does a lot of similar things to Quickwit. And yeah, to drive the index cluster they rely on https://github.com/datafuselabs/openraft && https://github.com/datafuselabs/opendal. I'd be interested about you thoughts on the project if you've already heard about it too.

Suggest a related project