Skip the API, Ship Your Database

• litefs

  38 3,620 8.0 Go

  FUSE-based file system for replicating SQLite databases across a cluster of machines

  

Author here. I think we could have set better expectations with our Postgres docs. It wasn't meant to be a managed service but rather some tooling to help streamline setting up a database and replicas. I'm sorry about the troubles you've had and that it's come off as us being disingenuous. We blog about things that we're working on and find interesting. It's not meant say that we've figured everything out but rather this is what we've tried.

As for this post, it's not managed SQLite but rather an open source project called LiteFS [1]. You can run it anywhere that runs Linux. We use it in few places in our infrastructure and found that sharing the underlying database for internal tooling was really helpful for that use case.

[1]: https://github.com/superfly/litefs

• hn-search

  1,619 524 2.9 TypeScript

  Hacker News Search

  

I was really excited about fly.io at one point but after reading all the recent posts(1) on HN I don't have trust in their services anymore. Hope they are working on improving system stability first.

(1) https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• gossip-glomers

  12 85 4.5 Go

  My solutions to the Glomers Challenge: a series of distributed systems challenges.

LiteFS works similarly to async replication you'd find in Postgres or MySQL so it doesn't try to be as strict as something running a distributed consensus protocol like Raft. The guarantees for async replication are fairly loose so I'm not sure Jepsen testing would be useful for that per se.

On the LiteFS Cloud side, it currently does streaming backups so it has similar guarantees but we are expanding its feature set and I could see running Jepsen testing on that in the future. We worked with Kyle Kingsbury in the past on some distributed systems challenges[1] and he was awesome to work with. Would definitely love to engage with him again.

[1]: https://fly.io/dist-sys/

• electric

  27 4,784 9.8 Elixir

  Local-first sync layer for web and mobile apps. Build reactive, realtime, local-first apps directly on Postgres.

  

I have more interest in this: https://electric-sql.com/

They are adding a sync-mechanism for Sqlite so local writes can be synced to a remote location and on into Postgres and so on. CRDT-based eventual consistency.

So local write latency, eventually consistent sync and the tools for partial sync and user access are the primary areas of development.

Early days but an interesting approach to shipping the db.

• litevfs

  1 39 8.9 Rust

  LiteFS VFS SQLite extension for serverless environments

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project