pgBackRest
pgx
pgBackRest | pgx | |
---|---|---|
13 | 19 | |
2,221 | 2,376 | |
3.1% | - | |
9.2 | 9.6 | |
14 days ago | about 1 year ago | |
C | Rust | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pgBackRest
-
pgBackRest: PostgreSQL S3 backups
This tutorial explains how to backup PostgreSQL database using pgBackRest and S3.
-
Anything can be a message queue if you use it wrongly enough
This isn't theoretical; many companies do PostgreSQL async 1:N physical replication, by using e.g. https://pgbackrest.org/ to have the primary push WAL segment files (a.k.a. "the last n milliseconds of packets" in the write-ahead log) as objects to S3, and then to have all read-replicas fetch from S3 and replay.
> You could do even better if you out-of-band signal the readiness so you do not need to poll while idle.
S3 and its clones have "object lifecycle notifications", where you can be informed by a push-based mechanism whenever a new object is put into the bucket.
But — what do you have to do, to get these notifications?
Subscribe to a message queue that S3 puts them into.
-
Kubernetes postgres backups
I haven't explored the territory in awhile but for bare-metal, you can't go wrong with Percona Distribution, which includes pgBackRest and a minimal web-ui. No one ever got fired for using Percona, etc.
- pgBackRest - Reliable PostgreSQL Backup & Restore
- pgBackRest - have you used it and what was your experience?
-
How to backup database
Check out pgBackRest
-
Use One Big Server
I found this approach pretty cool in that regard: https://github.com/pgbackrest/pgbackrest
- Moving from Oracle to Postgres, what should I know?
-
How do you back up your databases?
Something like PG barman or pg backrest could be good for you on the Postgres side.
-
Cloud SQL is not great
Backups are limited. These days, pgbackrest is the go-to backup solution for PostgreSQL, and having used it I am very impressed so far. It provides full backups, differential, and incremental, as well as archiving of WAL segments for point in time recovery. It allows great flexibility in schedules and destinations for backups, how long to keep backups for, how many full backups. For example, you can have backups made to a local disk, and other backups to an external S3-compatible bucket, each with their own settings and schedules (e.g., scheduled via cron).
pgx
-
Write Postgres functions in Rust
It uses pgx (https://github.com/tcdi/pgx) which is our more generalized framework for developing Postgres extensions with Rust.
-
Why not Rust for Omnigres?
It's a great question, considering I've been using Rust for a number of years now, and I generally advocate its use for its rich ecosystem, safety and tooling. I actively contribute to pgx, a library for building Postgres extensions in Rust. Yet, Omnigres appears to be all done in C.
-
Supabase Wrappers: A Framework for Building Postgres Foreign Data Wrappers
Our release today is a framework which extends this functionality to other databases/systems. If you’re familiar with Multicorn[1] or Steampipe[2], then it’s very similar. The framework is written in Rust, using the excellent pgx[3].
We have developed FDWs for Stripe, Firebase, BigQuery, Clickhouse, and Airtable (all in various “pre-release” states). The plan is to focus on the tools we’re using internally while we stabalize the framework.
There’s a lot in the blog post into our goals for this release. It’s early, but one of the things I’m most excited about.
[0] Postgres FDW: [https://www.postgresql.org/docs/current/sql-createforeigndat...
[1] Multicorn: https://multicorn.org/
[2] Steampipe: https://steampipe.io/
[2] pgx: [https://github.com/tcdi/pgx](https://github.com/tcdi/pgx)
- Apache Age, a PostgreSQL Extension with Graph Database Functionality
-
Postgres FTS vs the new wave of search engines
BTW one nice easter egg is that with pgx there is actually no reason that we can't build even better search solutions inside the database itself.
-
Postgres Full Text Search vs. the Rest
> That thread led me to a project/product idea where you take an existing Postgres instance used for normal products or whatever, replicate it to various read only clusters with a custom search extension loaded and some orchestrator sitting on top (I’ve written most of one in rust that uses 0mq to communicate with it’s nodes) and create drop in search from existing databases with a nice guided web gui for automatic tuning suitable for most business use cases.
Very interesting idea -- just want to add one thing, write it in rust (with pgx?[0]) :)
[0]: https://github.com/tcdi/pgx
-
Show HN: pg_idkit, a Postgres extension for generating exotic UUIDs
Hey HN,
It turns out choosing a good database-optimized UUID (and deciding whether to use serial, etc) isn't quite so simple, and I finally got a chance to do some exploration, write about it[0].
One of the reasons Postgres is the best open source database out there is it's extensibility -- so I hacked up a small extension for generating some of the more exotic (but crucially, lexicograhically sortable) UUID generation mechanisms:
https://github.com/t3hmrman/pg_idkit
This idea has been bumbling around my head for a while, but I finally got a chance to build it while working with Supabase on a post about IDs[0]!
Most of the heavy lifting is done by pgx[1] which is an amazing framework for building Postgres extensions in Rust. I think we are very early to the trend of amazing postgres extensions built in Rust, and it's yet another reason that it's an exciting time to be all-in on Postgres.
[0]: https://supabase.com/blog/choosing-a-postgres-primary-key
[1]: https://github.com/tcdi/pgx
[0]: https://supabase.com/blog/choosing-a-postgres-primary-key
-
Introducing pg_idkit: an extension for generating lexicographically sortable UUIDs (UUIDv6-8, CUID, Timeflake) in Postgres
The extension is still WIP but for those of ya'll that like Rust it's built on pgx which has excellent DX. The rust involved isn't complicated -- I'm basically laundering the functionality from other crates that are listed in the README.md.
-
GitHub - supabase/pg_jsonschema: PostgreSQL extension providing JSON Schema validation
Seems to be using this: https://github.com/tcdi/pgx
-
Show HN: Pg_jsonschema – A Postgres extension for JSON validation
- https://github.com/furstenheim/is_jsonb_valid
pgx[0] is going to be pretty revolutionary for the postgres ecosystem I think -- there is so much functionality that can be utilized at the database level and I can't think of a language I want to do it with more than Rust.
[0]: https://github.com/tcdi/pgx
What are some alternatives?
Barman - Barman - Backup and Recovery Manager for PostgreSQL
tauri - Build smaller, faster, and more secure desktop applications with a web frontend.
wal-g - Archival and Restoration for databases in the Cloud
code - Source code for the book Rust in Action
docker-postgres-wale - Postgres docker container with WALE-E installed
bevy - A refreshingly simple data-driven game engine built in Rust
wal-e - Continuous Archiving for Postgres
postgrest - REST API for any Postgres database
pghoard - PostgreSQL® backup and restore service
supabase-graphql-example - A HackerNews-like clone built with Supabase and pg_graphql
postgres - Docker Official Image packaging for Postgres
feophant - A PostgreSQL inspired SQL database written in Rust.