SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python Postgresql Projects
-
Redash
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
-
I picked a few of them on the hacktoberswag.com website. Precisely three: pusher.js, refine.dev, and MindsDB. You are probably asking Oh, you did not pick Wasp? The thing was, Wasp wasn’t listed on that web page and I didn’t know if any tool by that name existed.
-
InfluxDB
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.
-
full-stack-fastapi-postgresql
Full stack, modern web application generator. Using FastAPI, PostgreSQL as database, Docker, automatic HTTPS and more.
Project mention: ORM for FastAPI+PostgreSQL, Tortoise or Sqlalchemy? what would you choose and why? | reddit.com/r/Python | 2023-01-29 -
Project mention: Postgres: ERROR: column d.adsrc does not exist | reddit.com/r/PostgreSQL | 2022-05-23
Home: http://pgcli.com
-
Project mention: Awesome list of VCs investing in commercial open-source startups | reddit.com/r/opensource | 2022-09-14
OpenReplay - Elastic license
-
dev-setup
macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.
Something like this at least is the most direct answer to your question, as opposed to "you're doing it wrong" which unfortunately seems to be more upvoted. An example of something like this might be https://github.com/donnemartin/dev-setup
-
asyncpg: 5.5k starts, last commit recently, ~150 issues, some incompatibility, few open PRs, extensive README. Includes benchmark showing it's supposedly 3x faster than aiopg and psycopg2, psycopg3 is not mentioned in the benchmark.
-
Sonar
Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
-
-
-
If I was answering this question but for python, I'd recommend something like prefect, boto3, or tortoise-orm -- not extremely complex and with a pretty comprehensible featureset.
-
pony – Pony Object Relational Mapper
-
If you wish to auto-generate migrations, there are declarative schema change tools available for most relational databases. I'm the creator of Skeema [1] which provides them for MySQL, but there are options for other DBs too [2][3][4].
Prisma's migration system actually partially copied Skeema's design, while giving credit in a rather odd fashion which really rubbed me the wrong way: "The workflow of working with temporary databases and introspecting it to determine differences between schemas seems to be pretty common, this is for example what skeema does." [5]
While I doubt I was the first person to ever use that technique, I absolutely didn't copy it from anywhere, and it was never "pretty common". I'm not aware of any other older schema change systems that work this way.
[2] https://github.com/djrobstep/migra
[3] https://github.com/k0kubun/sqldef
[4] https://david.rothlis.net/declarative-schema-migration-for-s...
[5] https://github.com/prisma/prisma-engines/blob/6be410e/migrat...
-
By the way I was introduced to Ibis https://github.com/ibis-project/ibis recently, I have mix feelings about it.
-
-
I did data engineering for 6 years and am building a company to automate SQL validation for dbt users.
First, by “testing SQL pipelines”, I assume you mean testing changes to SQL code as part of the development workflow? (vs. monitoring pipelines in production for failures / anomalies).
If so:
1 – assertions. dbt comes with a solid built-in testing framework [1] for expressing assertions such as “this column should have values in the list [A,B,C]” as well checking referential integrity, uniqueness, nulls, etc. There are more advanced packages on top of dbt tests [2]. The problem with assertion testing in general though is that for a moderately complex data pipeline, it’s infeasible to achieve test coverage that would cover most possible failure scenarios.
2 – data diff: for every change to SQL, know exactly how the code change affects the output data by comparing the data in dev/staging (built off the dev branch code) with the data in production (built off the main branch). We built an open-source tool for that: https://github.com/datafold/data-diff, and we are adding an integration with dbt soon which will make diffing as part of dbt development workflow one command away [2]
We make money by selling a Cloud solution for teams that integrates data diff into Github/Gitlab CI and automatically diffs every pull request to tell you the how a change to SQL affects the target table you changed, downstream tables and dependent BI tools (video demo: [3])
I’ve also written about why reliable change management is so important for data engineering and what are key best practices to implement [4]
-
-
mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
-
-
-
baserow
Baserow is an open source no-code database tool and Airtable alternative. This is a mirrored repository, the official one is hosted on https://gitlab.com/bramw/baserow.
-
aiopg: 1.3k starts, last commit 1 nov 2021, recent bug in newer SQLAlchemy version, few open PRs, most recent PRs did not get a contributor response.
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-01-31.
Python Postgresql related posts
- Ask HN: How do you test SQL?
- pg_lock_tracer - A BPF based lock tracer for the PostgreSQL database
- Patroni Version 3.0.0 Released
- ORM for FastAPI+PostgreSQL, Tortoise or Sqlalchemy? what would you choose and why?
- Data service that streams data into our postgres table
- Any self hostable postgres clustering, replication and fail over system?
- A BPF based lock tracer for the PostgreSQL database
-
A note from our sponsor - #<SponsorshipServiceOld:0x00007fea6032ed10>
www.saashub.com | 1 Feb 2023
Index
What are some of the best open-source Postgresql projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | Redash | 22,501 |
| 2 | MindsDB | 12,526 |
| 3 | full-stack-fastapi-postgresql | 10,985 |
| 4 | pgcli | 10,857 |
| 5 | openreplay | 6,817 |
| 6 | dev-setup | 5,872 |
| 7 | asyncpg | 5,818 |
| 8 | patroni | 5,172 |
| 9 | wal-e | 3,368 |
| 10 | tortoise-orm | 3,347 |
| 11 | PonyORM | 3,116 |
| 12 | migra | 2,658 |
| 13 | ibis | 2,361 |
| 14 | Gopherus | 2,174 |
| 15 | data-diff | 2,048 |
| 16 | pg_activity | 2,015 |
| 17 | mara-pipelines | 1,969 |
| 18 | Barman | 1,483 |
| 19 | fapro | 1,377 |
| 20 | baserow | 1,343 |
| 21 | aiopg | 1,296 |
| 22 | pghoard | 1,192 |
| 23 | spilo | 1,084 |
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com