transcripts
litefs
transcripts | litefs | |
---|---|---|
15 | 38 | |
452 | 3,636 | |
1.1% | 2.5% | |
9.8 | 8.0 | |
3 days ago | 3 months ago | |
JavaScript | Go | |
Creative Commons Attribution Share Alike 4.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
transcripts
-
Fly.io Postgres cluster went down for 3 days, no word from them about it
- While experimenting with machines, after many creations & deletions, one volume could not be deleted. Next day, the volume was gone.
That's about it after 15 months of running production workloads on Fly.io.
We mention about our Fly.io experience often in our Kaizen pod episodes, which we publish every ~2 months: https://changelog.com/topic/kaizen. For anyone curious, this is the episode in which we announced the migration: https://changelog.com/shipit/50. There is a detailed PR which goes with it: https://github.com/thechangelog/changelog.com/pull/407. We've been talking about our migration plan from apps v1 (Nomad) to apps v2 (flyd) recently: https://changelog.com/friends/2#transcript-138
I'm sorry to hear that many of you didn't have the best experience. I know that things will continue improving at Fly.io. My hope is that one day, all these hard times will make for great stories. This gives me hope: https://community.fly.io/t/reliability-its-not-great/11253
Keep improving.
-
ceva aplicații care să mă ajute să fiu la curent cu programming/tech news? Începătoare aici. Bonus dacă au și opțiunea de widget. Mulțumesc!
https://changelog.com/ https://softwareengineeringdaily.com/ https://www.devopsbulletin.com/
- The Story of Heroku
- Code repositories that help you to become a better Elixir programmer
-
What are some good YouTube channels or podcasts that talk about the CS world?
Changelog (main, Go Time, Ship It)
-
Your Roadmap to Become a DevOps Engineer in 2022
Join Developer community forums like dev.to, Hashnode, Dzone, DevOps subreddit, Stackoverflow, DevOps StackExchange, Changelog, etc DevOps is taking the center stage and as we have mentioned before, it is becoming the epitome of software development. DevOps engineers are one of the highest-paid professionals in the world and this is the demanding tech job currently around the world. DevOps is a good career path and a proper plan and approach will get you a good job but once you get into it, it is highly recommended to always keep learning since the DevOps space is always evolving and new tools are emerging day by day. BTW, sometimes it can be difficult to get hired as a DevOps engineer without any prior work experience or knowledge of different tools and automation techniques, we at KodeKloud have come up with the KodeKloud Engineer to help you gain free DevOps work experience by solving real DevOps problems and challenges, with which you can get hired for DevOps role. Sign up for Free here.
-
Does anyone know of any good podcasts that are coder/programmers just talking shop? I am looking preferably for C# or C++, but any is fine really.
I haven’t had much luck finding programming podcasts involving ecosystems outside of JavaScript. That said, my top JS pick is JS Party. Also good tech/ coding related are The Changlog and Corecursive.
- Podcasts für Programmierer
-
Podcasts?
Changelog
-
How do you keep up with the developer ecosystem?
Personally I check Hacker News for some brain candy around once a day. I also read Lobsters for a slower moving but equally more thorough stream of tech news. Podcasts are an equally great source of information about what's happening. I like to listen to random episodes on the Changelog master feed.
litefs
-
Handle Incoming Webhooks with LiteJob for Ruby on Rails
Firstly, LiteJob's reliance on SQLite inherently restricts its horizontal scaling capabilities. Unlike other databases, SQLite is designed for single-machine use, making it challenging to distribute workload across multiple servers. This can certainly be done using novel technologies like LiteFS, but it is far from intuitive.
-
Experimenting on the Edge with Turso (and Go)
Im curious to know if others have tried out Turso or LiteFS or any of the newer edge db providers that are popping up in 'real world' applications and what your experiences have been?
-
Skip the API, Ship Your Database
Author here. I think we could have set better expectations with our Postgres docs. It wasn't meant to be a managed service but rather some tooling to help streamline setting up a database and replicas. I'm sorry about the troubles you've had and that it's come off as us being disingenuous. We blog about things that we're working on and find interesting. It's not meant say that we've figured everything out but rather this is what we've tried.
As for this post, it's not managed SQLite but rather an open source project called LiteFS [1]. You can run it anywhere that runs Linux. We use it in few places in our infrastructure and found that sharing the underlying database for internal tooling was really helpful for that use case.
[1]: https://github.com/superfly/litefs
-
SQLedge: Replicate Postgres to SQLite on the Edge
#. SQLite WAL mode
From https://www.sqlite.org/isolation.html https://news.ycombinator.com/item?id=32247085 :
> [sqlite] WAL mode permits simultaneous readers and writers. It can do this because changes do not overwrite the original database file, but rather go into the separate write-ahead log file. That means that readers can continue to read the old, original, unaltered content from the original database file at the same time that the writer is appending to the write-ahead log
#. superfly/litefs: aFUSE-based file system for replicating SQLite https://github.com/superfly/litefs
#. sqldiff: https://www.sqlite.org/sqldiff.html https://news.ycombinator.com/item?id=31265005
#. dolthub/dolt: https://github.com/dolthub/dolt
> Dolt can be set up as a replica of your existing MySQL or MariaDB database using standard MySQL binlog replication. Every write becomes a Dolt commit. This is a great way to get the version control benefits of Dolt and keep an existing MySQL or MariaDB database.
#. pganalyze/libpg_query: https://github.com/pganalyze/libpg_query :
> C library for accessing the PostgreSQL parser outside of the server environment
#. Ibis + Substrait [ + DuckDB ]
> ibis strives to provide a consistent interface for interacting with a multitude of different analytical execution engines, most of which (but not all) speak some dialect of SQL.
> Today, Ibis accomplishes this with a lot of help from `sqlalchemy` and `sqlglot` to handle differences in dialect, or we interact directly with available Python bindings (for instance with the pandas, datafusion, and polars backends).
> [...] `Substrait` is a new cross-language serialization format for communicating (among other things) query plans. It's still in its early days, but there is already nascent support for Substrait in Apache Arrow, DuckDB, and Velox.
#. benbjohnson/postlite: https://github.com/benbjohnson/postlite
> postlite is a network proxy to allow access to remote SQLite databases over the Postgres wire protocol. This allows GUI tools to be used on remote SQLite databases which can make administration easier.
> The proxy works by translating Postgres frontend wire messages into SQLite transactions and converting results back into Postgres response wire messages. Many Postgres clients also inspect the pg_catalog to determine system information so Postlite mirrors this catalog by using an attached in-memory database with virtual tables. The proxy also performs minor rewriting on these system queries to convert them to usable SQLite syntax.
> Note: This software is in alpha. Please report bugs. Postlite doesn't alter your database unless you issue INSERT, UPDATE, DELETE commands so it's probably safe. If anything, the Postlite process may die but it shouldn't affect your database.
#. > "Hosting SQLite Databases on GitHub Pages" (2021) re: sql.js-httpvfs, DuckDB https://news.ycombinator.com/item?id=28021766
#. awesome-db-tools https://github.com/mgramin/awesome-db-tools
- Fly.io Postgres cluster went down for 3 days, no word from them about it
-
LiteFS Cloud: Distributed SQLite with Managed Backups
LiteFS works sorta like that. It provides read replicas on all your application servers so you can use it just like vanilla SQLite for queries.
Write transactions have to occur on the primary node but that's mostly because of latency. SQLite operates in serializable isolation so it only allows one transaction at a time. If you wanted to have all nodes write then you'd need to acquire a lock on one node and then update it and then release the lock. We actually allow this on LiteFS using something called "write forwarding" but it's pretty slow so I wouldn't suggest it for regular use.
We're adding an optional a query API over HTTP [1] soon as well. It's inspired by Turso's approach. That'll let you issue one or more queries in a batch over HTTP and they'll be run in a single transaction.
[1]: https://github.com/superfly/litefs/issues/326
-
We Raised a Bunch of Money
Basically, LiteFS: https://github.com/superfly/litefs
And then some load balancer cleverness that reroutes writes to a specific VM: https://fly.io/blog/globally-distributed-postgres/
- Mycelite: SQLite extension to synchronize changes across SQLite instances
- Database suggestion to store and retrieve data
-
Key-value store has been added to Deno API
But my guess is they'll have an alternate implementation or something like LiteFS in Deno Deploy that will make this substantially more interesting when running in the Cloud.
What are some alternatives?
awesome-elixir - A curated list of amazingly awesome Elixir and Erlang libraries, resources and shiny things. Updates:
litestream - Streaming replication for SQLite.
gossip-glomers - My solutions to the Glomers Challenge: a series of distributed systems challenges.
sqlite-s3vfs - Python writable virtual filesystem for SQLite on S3
changelog.com - Changelog is news and podcast for developers. This is our open source platform.
dqlite - Embeddable, replicated and fault-tolerant SQL engine.
hexpm - API server and website for Hex
mvsqlite - Distributed, MVCC SQLite that runs on FoundationDB.
stylelint - A mighty CSS linter that helps you avoid errors and enforce conventions.
Bedrock - Rock solid distributed database specializing in active/active automatic failover and WAN replication
Lobsters - Computing-focused community centered around link aggregation and discussion
marmot - A distributed SQLite replicator built on top of NATS