gossip-glomers VS electric

There's a nice-looking series of exercises from fly.io: https://fly.io/dist-sys/

(I haven't actually done them myself yet, but they look great. Not a standalone resource, but good for practice)

Really worth noting that Maelstrom was the project they used to build the "Fly.io Distributed Systems Challenge" https://fly.io/dist-sys/ which was pretty popular at one point and discussed here, too. https://news.ycombinator.com/item?id=34897723

LiteFS works similarly to async replication you'd find in Postgres or MySQL so it doesn't try to be as strict as something running a distributed consensus protocol like Raft. The guarantees for async replication are fairly loose so I'm not sure Jepsen testing would be useful for that per se.

On the LiteFS Cloud side, it currently does streaming backups so it has similar guarantees but we are expanding its feature set and I could see running Jepsen testing on that in the future. We worked with Kyle Kingsbury in the past on some distributed systems challenges[1] and he was awesome to work with. Would definitely love to engage with him again.

[1]: https://fly.io/dist-sys/

They have really good tech blog posts. Also, they have https://fly.io/dist-sys/

- https://hackattic.com/ : Interesting programming Problems.

- https://sadservers.com/ : Learn Linux by solving problems.

- https://fly.io/dist-sys/ : Distributed Systems Problems.

- https://github.com/pingcap/talent-plan/ : System Programming / Distributed System Challenge.

- https://protohackers.com/ : Server Programming Challenges.

- https://codecrafters.io/ : Implement server tech / softwares from scratch.

- https://hyperskill.org/ : Lots of projects based tutorials.

- https://fly.io/dist-sys/ : Distributed Systems Problems.

Gossip Glomers https://fly.io/dist-sys/ by fly.io is a great way to learn distributed systems. They are fun to solve challenges. zio-maelstrom helps you get started faster in Scala!

There’s also this to practice https://fly.io/dist-sys/

Yeah no the embedded stuff is more a hobby, I'm interested professionally in stuff like what you said you're doing now in another comment, distributed systems and such. Infrastructure for cloud providers, that kind of thing. Right now I'm doing this distributed systems challenge series thing https://fly.io/dist-sys/ which should be cool to put on my github.

I'm interested in this problem also!

I think there is a large overlap with projects that market/focus on offline-first experiences.

AFAIK this problem can be solved by:

1) Considering a client-side copy of the database that gets synced with the remote DB. This is an approach [PowerSync](https://www.powersync.com/) and [ElectricSql](https://electric-sql.com/) and [rxdb](https://rxdb.info/) take!

Yeah I agree with it being an exaggeration. They are certainly riding the admittedly dated perception that realtime is so hard it's only available to the Googles and Figmas. But there's now some amazing open source solutions available like Y.js and ElectricSQL[1]. The barrier has certainly come down.

[1] https://github.com/electric-sql/electric

https://github.com/electric-sql/electric :

> ElectricSQL is a local-first software platform that makes it easy to develop high-quality, modern apps with instant reactivity, realtime multi-user collaboration and conflict-free offline support.

> Local-first is a new development paradigm where your app code talks directly to an embedded local database and data syncs in the background via active-active database replication. Because the app code talks directly to a local database, apps feel instant. Because data syncs in the background via active-active replication it naturally supports multi-user collaboration and conflict-free offline

"SQLedge: Replicate Postgres to SQLite on the Edge" (2023)

Yup, this is correct.

We have had some requests / discussions around adding hooks to the sync service that will support custom logic on the write path (as per https://github.com/electric-sql/electric/discussions/565). This seems like a good idea but they don't exist yet.