Python Postgresql

Open-source Python projects categorized as Postgresql

Top 23 Python Postgresql Projects

  • Redash

    Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

    Project mention: Recommend Django Great Projects | news.ycombinator.com | 2022-12-03
  • MindsDB

    In-Database Machine Learning

    Project mention: Making Something Waspy: A Review Of Wasp | dev.to | 2023-01-10

    I picked a few of them on the hacktoberswag.com website. Precisely three: pusher.js, refine.dev, and MindsDB. You are probably asking Oh, you did not pick Wasp? The thing was, Wasp wasn’t listed on that web page and I didn’t know if any tool by that name existed.

  • InfluxDB

    Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.

  • full-stack-fastapi-postgresql

    Full stack, modern web application generator. Using FastAPI, PostgreSQL as database, Docker, automatic HTTPS and more.

    Project mention: ORM for FastAPI+PostgreSQL, Tortoise or Sqlalchemy? what would you choose and why? | reddit.com/r/Python | 2023-01-29
  • pgcli

    Postgres CLI with autocompletion and syntax highlighting

    Project mention: Postgres: ERROR: column d.adsrc does not exist | reddit.com/r/PostgreSQL | 2022-05-23

    Home: http://pgcli.com

  • openreplay

    :tv: OpenReplay is developer-friendly, open-source session replay.

    Project mention: Awesome list of VCs investing in commercial open-source startups | reddit.com/r/opensource | 2022-09-14

    OpenReplay - Elastic license

  • dev-setup

    macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

    Project mention: Automate Mac setup? | reddit.com/r/macsysadmin | 2022-04-10

    Something like this at least is the most direct answer to your question, as opposed to "you're doing it wrong" which unfortunately seems to be more upvoted. An example of something like this might be https://github.com/donnemartin/dev-setup

  • asyncpg

    A fast PostgreSQL Database Client Library for Python/asyncio.

    Project mention: aiopg vs asyncpg vs psycopg3 | reddit.com/r/learnpython | 2022-06-28

    asyncpg: 5.5k starts, last commit recently, ~150 issues, some incompatibility, few open PRs, extensive README. Includes benchmark showing it's supposedly 3x faster than aiopg and psycopg2, psycopg3 is not mentioned in the benchmark.

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • patroni

    A template for PostgreSQL High Availability with Etcd, Consul, ZooKeeper, or Kubernetes

    Project mention: Patroni Version 3.0.0 Released | news.ycombinator.com | 2023-01-30
  • wal-e

    Continuous Archiving for Postgres

  • tortoise-orm

    Familiar asyncio ORM for python, built with relations in mind

    Project mention: Example typescript project repos? | reddit.com/r/typescript | 2022-10-27

    If I was answering this question but for python, I'd recommend something like prefect, boto3, or tortoise-orm -- not extremely complex and with a pretty comprehensible featureset.

  • PonyORM

    Pony Object Relational Mapper

    Project mention: This Week in Python | dev.to | 2022-05-20

    pony – Pony Object Relational Mapper

  • migra

    Like diff but for PostgreSQL schemas

    Project mention: Prisma laying off 28% staff | news.ycombinator.com | 2023-01-22

    If you wish to auto-generate migrations, there are declarative schema change tools available for most relational databases. I'm the creator of Skeema [1] which provides them for MySQL, but there are options for other DBs too [2][3][4].

    Prisma's migration system actually partially copied Skeema's design, while giving credit in a rather odd fashion which really rubbed me the wrong way: "The workflow of working with temporary databases and introspecting it to determine differences between schemas seems to be pretty common, this is for example what skeema does." [5]

    While I doubt I was the first person to ever use that technique, I absolutely didn't copy it from anywhere, and it was never "pretty common". I'm not aware of any other older schema change systems that work this way.

    [1] https://www.skeema.io

    [2] https://github.com/djrobstep/migra

    [3] https://github.com/k0kubun/sqldef

    [4] https://david.rothlis.net/declarative-schema-migration-for-s...

    [5] https://github.com/prisma/prisma-engines/blob/6be410e/migrat...

  • ibis

    Expressive analytics in Python at any scale.

    Project mention: Why use Python over SQL? | reddit.com/r/datascience | 2022-12-25

    By the way I was introduced to Ibis https://github.com/ibis-project/ibis recently, I have mix feelings about it.

  • Gopherus

    This tool generates gopher link for exploiting SSRF and gaining RCE in various servers

  • data-diff

    Efficiently diff data in or across relational databases

    Project mention: Ask HN: How do you test SQL? | news.ycombinator.com | 2023-01-31

    I did data engineering for 6 years and am building a company to automate SQL validation for dbt users.

    First, by “testing SQL pipelines”, I assume you mean testing changes to SQL code as part of the development workflow? (vs. monitoring pipelines in production for failures / anomalies).

    If so:

    1 – assertions. dbt comes with a solid built-in testing framework [1] for expressing assertions such as “this column should have values in the list [A,B,C]” as well checking referential integrity, uniqueness, nulls, etc. There are more advanced packages on top of dbt tests [2]. The problem with assertion testing in general though is that for a moderately complex data pipeline, it’s infeasible to achieve test coverage that would cover most possible failure scenarios.

    2 – data diff: for every change to SQL, know exactly how the code change affects the output data by comparing the data in dev/staging (built off the dev branch code) with the data in production (built off the main branch). We built an open-source tool for that: https://github.com/datafold/data-diff, and we are adding an integration with dbt soon which will make diffing as part of dbt development workflow one command away [2]

    We make money by selling a Cloud solution for teams that integrates data diff into Github/Gitlab CI and automatically diffs every pull request to tell you the how a change to SQL affects the target table you changed, downstream tables and dependent BI tools (video demo: [3])

    I’ve also written about why reliable change management is so important for data engineering and what are key best practices to implement [4]

    [1] https://docs.getdbt.com/docs/build/tests

  • pg_activity

    pg_activity is a top like application for PostgreSQL server activity monitoring.

    Project mention: pg_activity | reddit.com/r/devopspro | 2022-11-08
  • mara-pipelines

    A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

  • Barman

    Barman - Backup and Recovery Manager for PostgreSQL

  • fapro

    Fake Protocol Server

  • baserow

    Baserow is an open source no-code database tool and Airtable alternative. This is a mirrored repository, the official one is hosted on https://gitlab.com/bramw/baserow.

  • aiopg

    aiopg is a library for accessing a PostgreSQL database from the asyncio

    Project mention: aiopg vs asyncpg vs psycopg3 | reddit.com/r/learnpython | 2022-06-28

    aiopg: 1.3k starts, last commit 1 nov 2021, recent bug in newer SQLAlchemy version, few open PRs, most recent PRs did not get a contributor response.

  • pghoard

    PostgreSQL® backup and restore service

  • spilo

    Highly available elephant herd: HA PostgreSQL cluster using Docker

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-01-31.

Python Postgresql related posts

Index

What are some of the best open-source Postgresql projects in Python? This list will help you:

Project Stars
1 Redash 22,501
2 MindsDB 12,526
3 full-stack-fastapi-postgresql 10,985
4 pgcli 10,857
5 openreplay 6,817
6 dev-setup 5,872
7 asyncpg 5,818
8 patroni 5,172
9 wal-e 3,368
10 tortoise-orm 3,347
11 PonyORM 3,116
12 migra 2,658
13 ibis 2,361
14 Gopherus 2,174
15 data-diff 2,048
16 pg_activity 2,015
17 mara-pipelines 1,969
18 Barman 1,483
19 fapro 1,377
20 baserow 1,343
21 aiopg 1,296
22 pghoard 1,192
23 spilo 1,084
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com