coronavirus-dashboard-generic-apis
pgbouncer
Our great sponsors
| coronavirus-dashboard-generic-apis | pgbouncer | |
|---|---|---|
| 1 | 34 | |
| 6 | 2,648 | |
| - | 3.8% | |
| 3.0 | 8.7 | |
| 10 months ago | 4 days ago | |
| Go | C | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
coronavirus-dashboard-generic-apis
-
Cascade of doom: JIT, and how a Postgres update led to 70% failure on a critical national service
Number of grievances directed to me in Twitter increased. People were now reporting increased latency in our Generic API. This concerned me because unlike APIv2, which is aggressively throttled and is designed to download very large payloads, the Generic API has been implemented in the Go programming language using highly optimised queries for rapid response. Whilst a download from APIv2 may take 3 or 4 minutes to complete, the average latency for our Generic API is ~50 milliseconds.
pgbouncer
-
MongoDB and Load Balancer Support
Thanks to MongoDB drivers all consistently providing connection monitoring and pooling functionality, external connection pooling solutions aren't required (ex: Pgpool, PgBouncer). This allows applications built using MongoDB drivers to be resilient and scalable out of the box, but based on what we understand regarding the number of connections applications establish to MongoDB clusters it stands to reason that at a certain point as our application deployments increase, so will our connections.
-
Minha jornada de otimização de uma aplicação django
Pgbouncer - resolvia o problema do limite de conexões no postgres. Mas a API “saudável” manteve o número de conexões baixo o suficiente.
- PgBouncer 1.21.0 – "The one with prepared statements"
- Pgbouncer adds support for prepared statements
-
PgBouncer is useful, important, and fraught with peril
Pgbouncer maintainer here. Overall I think this is a great description of the tradeoffs that PgBouncer brings and how to work around/manage them. I'm actively working on fixing quite a few of the issues in this blog though
1. Named protocol-level prepared statements in transaction mode has a PR that's pretty close to being merged: https://github.com/pgbouncer/pgbouncer/pull/845
-
Supavisor: Scaling Postgres to 1 Million Connections
A common solution is connection pooling. Supabase currently offers pgbouncer which is single-threaded, making it difficult to scale. We've seen some novel ways to scale pgbouncer, but we have a few other goals in mind for our platform.
-
Citus 12: Schema-based sharding for PostgreSQL
Great observation! :)
We worked upstream to have `search_path` properly handled (tracked per client) by pgbouncer.
https://github.com/pgbouncer/pgbouncer/commit/8c18fc4d213ad4...
Check config.md in that commit for a verbose, humanized description.
What are some alternatives?
coronavirus-dashboard-summary - UK Coronavirus Dashboard - Summary pages
odyssey - Scalable PostgreSQL connection pooler
coronavirus-dashboard - Dashboard for tracking Coronavirus (COVID-19) across the UK
asyncpg - A fast PostgreSQL Database Client Library for Python/asyncio.
coronavirus-dashboard-pipeline-etl - UK Coronavirus Dashboard ETL
pgcat - PostgreSQL pooler with sharding, load balancing and failover support. [Moved to: https://github.com/postgresml/pgcat]
llvm-project - The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
TimescaleDB - An open-source time-series SQL database optimized for fast ingest and complex queries. Packaged as a PostgreSQL extension.
pgcat - PostgreSQL pooler with sharding, load balancing and failover support.
rds-auth-proxy - A "passwordless" login experience for your AWS RDS
citus - Distributed PostgreSQL as an extension