river VS CryptPad

River is a Python library for online machine learning. Online machine learning can dynamically adapt to new patterns in the data, or when the data itself is generated as a function of time, e.g., stock price prediction, content personalization.

Today, I'm going to take you on a thrilling coding adventure inspired by a LinkedIn code snippet, where I tangled with FastAPI, River, Watchdog, and Tenacity. Ready? Buckle up!

Complimentary: river and skorch

River - https://github.com/online-ml/river (Online machine learning, best used with Bytewax for Kafka integration)

Hey, great work. Do you think this algorithm would be amenable to be done online? I'm the author of River (https://riverml.xyz) where we're looking for good online clustering algorithms.

If you don't know Rust, but know Python, you can install Python libraries written in Rust with pip. Like, pip install polars or pip install robyn. In this case you follow the two bottom links. But then you don't write your own libraries and stuff so.. I guess that's not what you want.

But, if you want to learn Rust, you probably wouldn't start out with pyo3. You first install Rust with https://rustup.rs/ and then check out the official book, and the book rust by example, that you can find here https://www.rust-lang.org/learn - and maybe write some code on the Rust playground https://play.rust-lang.org/ - then, you use pyo3 to build Python libraries in Rust, and then use maturin https://www.maturin.rs/ to build and publish them to Pypi.

But if you still prefer to begin with Rust by writing Python libraries (it's a valid strategy if you are very comfortable with working with multiple stacks), the Maturin link has a tutorial that setups a program that is half written in python, half written in Rust, https://www.maturin.rs/tutorial.html (well the pyo3 link I sent also has one too. You should refer to the documentation of both, because you will use the two together)

After learning Rust, the next step is looking for libraries that you could leverage to make Python programs ultra fast. Here https://github.com/rayon-rs/rayon is an obvious choice, see some examples from the Rust cookbook https://rust-lang-nursery.github.io/rust-cookbook/concurrenc... - when you create a parallel iterator, it will distribute the processing to many threads (by default, one per core). The rust cookbook, by the way, is a nice reference to see the most used crates (Rust libraries) in the Rust ecosystem.

Anyway there are some posts about pyo3 on the web, like this blog post https://boring-guy.sh/posts/river-rust/ (note: it uses an outdated version of pyo3, and doesn't seem to use maturin which is a newer tool). This post was written by the developers of https://github.com/online-ml/river - another Python library written in Rust

Oh they definitely can be incrementally updated, there is just added complexity. Online learning has been used with more classical machine learning methods in real-time analytics for a while now. River is a library that handles that.

We have both bandits and FTRL implemented in River (https://riverml.xyz) if that helps.

In my frustration with MS Office, I gave it a chance and searched for MS Office alternatives ... and found https://github.com/cryptpad/cryptpad ! Looks quite nice. Maybe I should set that up on a server.

https://cryptpad.org/

There's a public instance in France to try it out.

CryptPad provides a full-fledged office suite with all the tools necessary for productive collaboration.

I discovered these 3 amazing projects recently:

Cryptpad, essentially google docs/sheets/forms e2e encrypted. It does include collaboration. https://github.com/cryptpad/cryptpad

Immich, google photos self hostable, with share options https://github.com/immich-app/immich

Nginxproxymanager manages certificates and proxies to self hosted stuff through nginx https://github.com/NginxProxyManager/nginx-proxy-manager

Great self hosting stuff!

I work for XWiki SAS. Two products we develop have it:

- XWiki, a extensible wiki platform, experimentally [1] but soon to be fully supported

- CryptPad [2], an end-to-end encrypted collaborative platform. And actually, CryptPad was accidentally born as a first attempt to have this feature in XWiki.

[1] https://extensions.xwiki.org/xwiki/bin/view/Extension/Realti...

[2] https://cryptpad.org/

Hey, very happy to see you so enthusiastic!

I'll be sure to transmit your feedback to the CryptPad team.

I'm not an expert myself so while I might know some stuff, it'd be better to talk to them directly.

Come say hello on the Matrix #cryptpad-general channel [1], don't hesitate to open issues on the bug tracker, and to browse the CryptPad's website [2].

[1] https://matrix.to/#/#cryptpad-general:matrix.xwiki.com

[2] https://cryptpad.org/

https://cryptpad.org https://cryptpad.fr

It's not LibreOffice, but while revisiting CryptPad (which I thought was a multiplayer notepad like etherpad or codimd, except with an encryption key in the url fragment identifier) I was impressed to see that they're expanding to become an entire office suite. You get a WYSIWYG editor (I'd rather wish for markdown but ok), spreadsheet editor, survey forms, and more which I don't remember, all live like google docs but (as I understand it, I didn't audit it) end to end encrypted between the users. It's a bit sluggish because everything has to happen on the client side, so it's a lot of JavaScript, but after the page loads it works smoothly. You can self host it as well, there's a list of instances somewhere on https://cryptpad.org with the official instance being https://cryptpad.fr

LibreOffice has a ton more features and is way harder to port. Case in point: I was at an open source conference where LibreOffice proudly demo'd their new server version, saying it used mapnik. Me, confused, asked huh why'd you use an OpenStreetMap rendering library? Turns out they basically run the ancient C++ UI on the server and make a VNC-like connection and that map tiles is the easiest or fastest way to load the screen. At least, that's what I remember from that presentation, I haven't looked into that madness further, but that's LibreOffice online...

Currently I'm looking at https://cryptpad.org/. But maybe there is an alternative that sucks even less?!