Python SQL

Open-source Python projects categorized as SQL
Edit details
Topics: Python Database Sqlite Postgres Postgresql
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 23 Python SQL Projects

  • devops-exercises

    Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions

    • Project mention: DevOps Exercises | news.ycombinator.com | 2023-08-07

  • sqlmodel

    SQL databases in Python, designed for simplicity, compatibility, and robustness.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • q

    q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)

  • modin

    Modin: Scale your Pandas workflows by changing a single line of code

    • Project mention: The Distributed Tensor Algebra Compiler (2022) | news.ycombinator.com | 2023-06-15

  • datasette

    An open source multi-tool for exploring and publishing data

    • Project mention: Ask HN: High quality Python scripts or small libraries to learn from | news.ycombinator.com | 2024-04-19

    Simon Willison's github would be a great place to get started imo -

    https://github.com/simonw/datasette

  • SQLAlchemy

    The Database Toolkit for Python

    • Project mention: Python: A SQLAlchemy Wrapper Component That Works With Both Flask and FastAPI Frameworks | dev.to | 2024-05-03

    In SQLAlchemy, models representing database tables typically subclass sqlalchemy.orm.DeclarativeBase (this class supersedes the sqlalchemy.orm.declarative_base function). Accordingly, the abstract base class in this database wrapper component is a sqlalchemy.orm.DeclarativeBase subclass, accompanied by another custom base class providing additional dunder methods.

  • sqlfluff

    A modular SQL linter and auto-formatter with support for multiple dialects and templated code.

    • Project mention: 🐍🐍 23 issues to grow yourself as an exceptional open-source Python expert 🧑‍💻 🥇 | dev.to | 2023-10-19

    Repo : https://github.com/sqlfluff/sqlfluff

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • Mage

    🧙 The modern replacement for Airflow. Mage is an open-source data pipeline tool for transforming and integrating data. https://github.com/mage-ai/mage-ai

    • Project mention: FLaNK AI-April 22, 2024 | dev.to | 2024-04-22

  • sqlglot

    Python SQL Parser and Transpiler

    • Project mention: The Future of MySQL is PostgreSQL: an extension for the MySQL wire protocol | news.ycombinator.com | 2024-04-26

    This is probably referring to "zero changes to your driver code" and not "zero changes to the SQL you send over this driver".

    Translating between SQL dialects is notoriously hard and attempts to translate [1] are working in 95% of cases. But the last 5% would require 5x amount of work. That's because "SQL dialect" also includes weird edge cases of type inference of things like COALESCE(5, FALSE) and emulation of system catalogs (pg_catalog, information_schema).

    [1] https://github.com/tobymao/sqlglot

  • dataset

    Easy-to-use data handling for SQL data stores with support for implicit table creation, bulk loading, and transactions.

  • Flask-AppBuilder

    Simple and rapid application development framework, built on top of Flask. includes detailed security, auto CRUD generation for your models, google charts and much more. Demo (login with guest/welcome) - http://flaskappbuilder.pythonanywhere.com/

    • Project mention: Pretty simple question, could be rewarding if enough people answer. | /r/flask | 2023-06-06

    This one might be interesting as well: https://github.com/dpgaspar/Flask-AppBuilder

  • ibis

    the portable Python dataframe library

    • Project mention: Show HN: Hashquery, a Python library for defining reusable analysis | news.ycombinator.com | 2024-04-23

    I really don't understand the appeal of dbt vs a proper programming language. The templating approach leads to massive spaghetti. I look forward to trying out something like Ibis [0]

    0: https://ibis-project.org/

  • data-diff

    Compare tables within or across databases

    • Project mention: How to Check 2 SQL Tables Are the Same | news.ycombinator.com | 2023-07-26

    If the issue happen a lot, there is also: https://github.com/datafold/data-diff

    That is a nice tool to do it cross database as well.

    I think it's based on checksum method.

  • ethereum-etl

    Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

    • Project mention: Blockchain transactions decoding: making wallet activity understandable | dev.to | 2023-10-27

    Event is a log entity which EVM smart contracts can emit during transaction execution. Events are very good at signalling that an some action has taken place on-chain. Applications can subscribe and listen to events to trigger some off-chain logic or they can index, transform and store events in some off-chain storage (look at The Graph protocol or Ethereum ETL).

  • alembic

    A database migrations tool for SQLAlchemy.

  • pg_activity

    pg_activity is a top like application for PostgreSQL server activity monitoring.

    • Project mention: FLaNK AI for 11 March 2024 | dev.to | 2024-03-11

  • PyPika

    PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.

    • Project mention: any recommendations for a good query builder library with good support? | /r/learnpython | 2023-07-11

    I recently started using drizzle orm and I am now looking for something similar in python, my goal is to be as close to sql syntax as possible without just passing dml commands as strings, type safety would be cool as well, I saw this one pypika but it ha a lot of open issues and no commits for a year, is there anything similar but more stable?

  • django-sql-explorer

    Easily share data across your company via SQL queries. From Grove Collab.

    • Project mention: Online Django Development Sprint, October 19-20. | /r/django | 2023-10-19

  • fugue

    A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

    • Project mention: FLaNK Stack Weekly 22 January 2024 | dev.to | 2024-01-22

  • djongo

    Django and MongoDB database connector

    • Project mention: Problems with DjOngo | /r/django | 2023-05-05

  • learning

    Learning Shell，Python，Golang，System，Network (by anzhihe)

  • jet-bridge

    Jet Admin – No-code Business App builder

  • Cubes

    [NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python SQL related posts

Index

What are some of the best open-source SQL projects in Python? This list will help you:

Project Stars
1 devops-exercises 63,556
2 sqlmodel 13,030
3 q 10,126
4 modin 9,486
5 datasette 8,955
6 SQLAlchemy 8,807
7 sqlfluff 7,219
8 Mage 7,050
9 sqlglot 5,573
10 dataset 4,720
11 Flask-AppBuilder 4,514
12 ibis 4,241
13 data-diff 2,847
14 ethereum-etl 2,823
15 alembic 2,467
16 pg_activity 2,397
17 PyPika 2,378
18 django-sql-explorer 2,203
19 fugue 1,880
20 djongo 1,854
21 learning 1,697
22 jet-bridge 1,569
23 Cubes 1,490

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com