Python SQL

Open-source Python projects categorized as SQL

Top 23 Python SQL Projects

  • devops-exercises

    Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions

    Project mention: Kubernetes Labs for learning | reddit.com/r/kubernetes | 2022-11-27
  • q

    q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)

    Project mention: sqly - execute SQL against CSV / JSON with shell | reddit.com/r/SQL | 2022-11-10

    Apparently, there were many who thought the same thing; Tools to execute SQL against CSV were trdsql, q, csvq, TextQL. They were highly functional, hoewver, had many options and no input completion. I found it just a little difficult to use.

  • Zigi

    Close all those tabs. Zigi will handle your updates.. Zigi monitors Jira and GitHub updates, pings you when PRs need approval and lets you take fast actions - all directly from Slack! Plus it reduces cycle time by up to 75%.

  • sqlmodel

    SQL databases in Python, designed for simplicity, compatibility, and robustness.

    Project mention: Best ORM to use with FastAPI? | reddit.com/r/Python | 2022-05-21

    I have not used it myself but the creator of fastapi has made https://github.com/tiangolo/sqlmodel

  • modin

    Modin: Scale your Pandas workflows by changing a single line of code

    Project mention: Working with more than 10gb csv | reddit.com/r/datascience | 2022-10-05

    Modin should fit. It implements Pandas APIs with e.g. Ray as backend. https://github.com/modin-project/modin

  • datasette

    An open source multi-tool for exploring and publishing data

    Project mention: Sunday Daily Thread: What's everyone working on this week? | reddit.com/r/Python | 2022-11-20

    Specifically the new chapter on SQLite (and also Datasette.)

  • SQLAlchemy

    The Database Toolkit for Python

    Project mention: Snowflake and SQLAlchemy tutorial: From installation to example queries | dev.to | 2022-11-23

    SQLAlchemy is one of the most popular libraries to interface with relational databases in Python. Its distinguishing feature is the object-relational mapper (ORM), which allows software engineers to develop classes and automatically map them to a database.

  • dataset

    Easy-to-use data handling for SQL data stores with support for implicit table creation, bulk loading, and transactions.

  • Scout APM

    Truly a developer’s best friend. Scout APM is great for developers who want to find and fix performance issues in their applications. With Scout, we'll take care of the bugs so you can focus on building great things 🚀.

  • Flask-AppBuilder

    Simple and rapid application development framework, built on top of Flask. includes detailed security, auto CRUD generation for your models, google charts and much more. Demo (login with guest/welcome) - http://flaskappbuilder.pythonanywhere.com/

    Project mention: ROLE BASED AUTHENTICATION IN FLASK | reddit.com/r/flask | 2022-02-23

    There's the Flask-Security extension for example. Or the Flask-Appbuilder framework, which does a whole lot more.

  • ethereum-etl

    Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

    Project mention: data engineering in web3 | reddit.com/r/dataengineering | 2022-05-20

    I'm surprised this is the only good response in this thread so far. Blockchain data is completely open but requires some organization in order to perform analytics. Nansen for example is a product that is built on top of ethereum-etl which you can checkout here

  • ibis

    Expressive analytics in Python at any scale.

    Project mention: A Critique of SQL, 40 Years Later | news.ycombinator.com | 2022-08-24

    Ibis might be an option. It has syntax similar to pandas and can compile to a number of types of sql, pyspark, or dask.

    https://github.com/ibis-project/ibis

  • django-sql-explorer

    Easily share data across your company via SQL queries. From Grove Collab.

    Project mention: Saving Filtered Querysets for Future Access | reddit.com/r/django | 2022-10-04
  • pg_activity

    pg_activity is a top like application for PostgreSQL server activity monitoring.

    Project mention: pg_activity | reddit.com/r/devopspro | 2022-11-08
  • PyPika

    PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.

  • sqlglot

    Python SQL Parser and Transpiler

    Project mention: MySQL-mimic - Python implementation of the MySQL server wire protocol. | reddit.com/r/Python | 2022-10-31

    \Note - mysql-mimic is just the wire protocol. We use* sqlglot to parse/optimize SQL.

  • djongo

    Django and MongoDB database connector

    Project mention: Where can I find the ORM documentation for Djongo (mongodb library for django)? | reddit.com/r/django | 2022-03-06
  • alembic

    A database migrations tool for SQLAlchemy.

    Project mention: Understanding a Data Model | dev.to | 2022-07-20

    SQLAlchemy ORM should support comments if you're using it to create database objects.

  • Cubes

    Light-weight Python OLAP framework for multi-dimensional data analysis

  • jet-bridge

    Jet Admin – No-code Business App builder

    Project mention: Show HN: No-code alternative to Retool, Appsmith, Internal, etc. | news.ycombinator.com | 2022-02-14

    My bad, just got caught up in pondering about the second part. You can choose from 3 deployment options: cloud, on-premise, and hybrid. The first and the last are pretty self-explanatory and in hybrid you can host the open-source backend part(https://github.com/jet-admin/jet-bridge) on your servers and we host the interface

  • cinemagoer

    Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb (to which we are not affiliated in any way) movie database about movies, people, characters and companies

    Project mention: [OC]IMDB Top 30 movies: cast death rate | reddit.com/r/dataisbeautiful | 2022-01-17
  • fugue

    A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark, Dask and Ray without any rewrites.

    Project mention: [P] Open data transformations in Python, no SQL required | reddit.com/r/MachineLearning | 2022-03-01

    This looks similar to fugue, am I right? How do they compare?

  • eralchemy

    Entity Relation Diagrams generation tool

    Project mention: Tools that help to explore and navigate database tables | reddit.com/r/dataengineering | 2022-11-21

    sometging like this, maybe https://github.com/Alexis-benoist/eralchemy

  • siuba

    Python library for using dplyr like syntax with pandas and SQL

    Project mention: Method Chaining in Pandas: Bad Form or a Recipe for Success? | news.ycombinator.com | 2022-11-02
  • fastapi-crudrouter

    A dynamic FastAPI router that automatically creates CRUD routes for your models

    Project mention: why when I search for Python jobs I find alot! but when I search for Django (the most used Python framework ) I get few compared to spring or nodejs ? | reddit.com/r/Python | 2022-08-21

    FastAPI does have an equivalent. Something like this? https://github.com/awtkns/fastapi-crudrouter

  • InfluxDB

    Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Data Platform where developers build real-time applications for analytics, IoT and cloud-native services in less time with less code.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-11-27.

Python SQL related posts

Index

What are some of the best open-source SQL projects in Python? This list will help you:

Project Stars
1 devops-exercises 33,863
2 q 9,696
3 sqlmodel 8,941
4 modin 8,062
5 datasette 6,671
6 SQLAlchemy 6,312
7 dataset 4,234
8 Flask-AppBuilder 3,967
9 ethereum-etl 2,297
10 ibis 2,191
11 django-sql-explorer 2,049
12 pg_activity 1,943
13 PyPika 1,842
14 sqlglot 1,800
15 djongo 1,654
16 alembic 1,643
17 Cubes 1,472
18 jet-bridge 1,284
19 cinemagoer 1,034
20 fugue 983
21 eralchemy 977
22 siuba 963
23 fastapi-crudrouter 918
Write Clean Python Code. Always.
Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
www.sonarsource.com