opendal
fluvio
opendal | fluvio | |
---|---|---|
10 | 26 | |
2,858 | 2,679 | |
2.5% | 3.7% | |
9.9 | 9.5 | |
1 day ago | 1 day ago | |
Rust | Rust | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
opendal
-
Welcome to Apache OpenDAL
Sounds likely.
The core part of OpenDAL is a Rust crate that provides fs-like APIs over different storage backends, but we also investigate providing other interfaces like a CLI. We have an experimental binary named `oli`[1].
You're welcome to start a discussion[2] to share how you use rclone and we may find it fit in OpenDAL's scope :D
[1] https://github.com/apache/incubator-opendal/tree/main/bin/ol...
-
Hey Rustaceans! Got a question? Ask here (49/2023)!
[profiles.mys3] type = "s3" region = "us-east-1" access_key_id = "foo" enable_virtual_host_style = "on" ``` The team at Opendal wrote a handcrafting config parser for the same use case, see. Since parsing configs in toml or json is a standard functionality, is there any recommended way?
-
Ask HN: Experience using your user's Google Drive instead of a database?
I've often felt we need an abstraction for just this. "Bring your own storage" so that you can sign up and provide a "bucket", then the service will write to that.
OpenDAL was on HN recently and would be a pretty decent abstraction to use for this: https://github.com/apache/incubator-opendal
-
Rust std:fs slower than Python
Totally unrelated but: this post talks about the bug being first discovered in OpenDAL [1], which seems to be an Apache (Incubator) project to add an abstraction layer for storage over several types of storage backend. What's the point/use case of such an abstraction? Anybody using it?
[1] https://opendal.apache.org/
-
S3 as the Storage Layer
https://github.com/apache/incubator-opendal
- Apache OpenDAL: A unified data access layer
- Apache OpenDAL
-
Way to Go: OpenDAL successfully entered Apache Incubator
A new big event in a few weeks, this may be the first project whose primary language is Rust to enter the Apache incubator. OpenDAL originated from the vision of creating a universal, unified and user-friendly data access layer. It came into being in late 2021, initially as a component of the Databend project.
-
[Need inspiration] Building the control plane of a search engine (Quickwit)
I was reading through the code of databend: https://databend.rs/ It's a "wrapper" over datafusion and does a lot of similar things to Quickwit. And yeah, to drive the index cluster they rely on https://github.com/datafuselabs/openraft && https://github.com/datafuselabs/opendal. I'd be interested about you thoughts on the project if you've already heard about it too.
-
[Announcement] Databend v0.7.0 Released!
Announce OpenDAL for object storage data access
fluvio
- Ask HN: WebSocket Relay?
- XFaaS: Hyperscale and Low Cost Serverless Functions at Meta
-
Iggy.rs – building message streaming in Rust
I'm not quite sure how this compares to Kafka and fluvio [1], a Kafka competitor also written in Rust?
Is it more of a message queue like rabbitmq?
[1] https://www.fluvio.io/
- Fluvio: Open-source data streaming platform
- Show HN: Fluvio – Distributed stream processing system written in Rust and WASM
-
Thank you for checking out the Fluvio repo
Seeing signs of the hockey stick traffic on the Fluvio Open Source repo: https://github.com/infinyon/fluvio
Stopped the mobile notifications for the stargazer bot on discord and slack to stop the dopamine rush!!!
But thank you for checking us out.
- Opens Source Rust and WASM Alternative to Kafka and Flink
- Fluvio is a high-performance distributed data streaming platform in Rust
- RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1)
-
Advice: I am 36, and i want to transition from ETL developer to Rust
Look at open source project fluvio https://github.com/infinyon/fluvio and see how we’re building a modern bus that can do ETL streaming style :).
What are some alternatives?
databend - 𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
nsq - A realtime distributed messaging platform
openraft - rust raft with improvements
datafuse - An elastic and reliable Cloud Warehouse, offers Blazing Fast Query and combines Elasticity, Simplicity, Low cost of the Cloud, built to make the Data Cloud easy [Moved to: https://github.com/datafuselabs/databend]
s3s - S3 Service Adapter
roapi - Create full-fledged APIs for slowly moving datasets without writing a single line of code.
dilbert-viewer - A simple comic viewer for Dilbert by Scott Adams
sccache - Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.
storage - A vendor-neutral storage library for Golang: Write once, run on every storage service.
rust-blog - Educational blog posts for Rust beginners
Docusaurus - Easy to maintain open source documentation websites.
cache - Cache dependencies and build outputs in GitHub Actions