wal-e
simple-pgvector-python
| wal-e | simple-pgvector-python | |
|---|---|---|
| 8 | 1 | |
| 3,469 | 6 | |
| 0.0% | - | |
| 3.0 | 6.3 | |
| over 1 year ago | almost 2 years ago | |
| Python | Python | |
| BSD 3-clause "New" or "Revised" License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wal-e
-
Ask HN: What do you use to backup your VMs?
For me, it's case-by-case. I don't back up the VMs directly, just the date of the stateful applications running on the VMs (or bare metal servers, I do identical stuff for them).
For postgres, I used to just have a systemd timer that would `pg_dumpall` and throw it in s3.
Now I use https://github.com/wal-e/wal-e to backup my postgresql databases.
For other local files, I use borg backup for personal files and services I just run for myself, and I use restic to backup server files to s3.
The operating system's configuration is all stored in git via the magic of NixOS, so I don't have to worry about files in /etc, they all are 100% reproducible from my NixOS configuration.
-
Run PostgreSQL. The Kubernetes Way
See the GitHub: https://github.com/wal-e/wal-e
Unmaintained would’ve made more sense to say, but the maintainer choose the words “obsolete” so I took those. :)
Seems to be obsolete due to a lack of interest and contributions.
-
Are stupid database questions allowed? If a database is backed up only every hour, do we just lose the unbacked up data within the one hour time frame?
I believe the idea originally started with Wal-E project (https://github.com/wal-e/wal-e) since then there were many improvements to it and AWS no doubt has their own proprietary solution.
-
Recovering a PostgreSQL Database After a Hard Drive Failure
Hope this helps someone out there.
https://github.com/wal-e/wal-e
-
Advice for syncing a Postgres database with a TimescaleDB database
Running your own postgres server on AWS is not difficult. You'll want to get familiar with EBS and look into using a tool like wal-e to manage your WAL logs and ensure yuor ability to recover from the various exciting failure modes that Amazon makes available to you.
-
Change Data Capture with Debezium
These read-replicas leveraged WAL segments created by the primary database; however, we didn’t want to bog down the primary database with each replica by reading directly from production. To circumvent this issue, we leverage wal-e, a tool that performs continuous archiving of PostgreSQL WAL files and base backups, and read replicas restored from s3 or gcs versus reading directly from the primary database.
-
Automate pg_basebackup in linux
Have a look at barman, pgBackrest or for maybe WAL-G or WAL-E
-
Backup Postgresql Docker
I am using the following docker image https://github.com/docker-library/postgres. I want the ability to make regular backups to my S3 bucket. PITR is not necessary but a nice to have. I've tried to use https://github.com/wal-e/wal-e but I've not found something that works very well with docker.
simple-pgvector-python
-
Understanding simple-pgvector-python: A Tool for Vector Search in Python
Explore the project on GitHub.
What are some alternatives?
wal-g - Archival and Restoration for databases in the Cloud
raglite - 🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
pgBackRest - Reliable PostgreSQL Backup & Restore
canopy - Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone
pghoard - PostgreSQL® backup and restore service
db-per-tenant - Example chat-with-pdf app showing how to provision a dedicated database instance for each user. In this app, every database uses pgvector for similarity search. Powered by Neon