Python Database

Open-source Python projects categorized as Database | Edit details
Related topics: #Python #SQL #Python3 #Sqlite #Postgresql

Top 23 Python Database Projects

  • SQLMap

    Automatic SQL injection and database takeover tool

    Project mention: I will hacker you 😈😈 | reddit.com/r/linuxmemes | 2022-05-06

    Actually python is powerful enough for developing hacking tools, just as Routersploit, SQLMap etc.

  • pgcli

    Postgres CLI with autocompletion and syntax highlighting

    Project mention: Postgres: ERROR: column d.adsrc does not exist | reddit.com/r/PostgreSQL | 2022-05-23

    Home: http://pgcli.com

  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

  • mycli

    A Terminal Client for MySQL with AutoCompletion and Syntax Highlighting.

    Project mention: 5 Useful Database Command Line Tools | dev.to | 2022-04-25

  • q

    q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)

    Project mention: OpenOffice. Necesito ver una hoja de cálculo que tiene 6 millones de columnas, pero no puedo | reddit.com/r/AskArgentina | 2022-05-15

  • edgedb

    A next-generation graph-relational database.

    Project mention: GraphQL Is a Trap? | news.ycombinator.com | 2022-05-06

    You have to do your own optimiser to avoid, for instance, the N+1 query problem. (Just Google that, plenty of explanations around.) Many GraphQL frameworks have a “naive” subquery implementation that performs N individual subqueries. You either have to override this for each parent/child pairing, or bolt something on the back to delay all the “SELECT * FROM tbl_subquery WHERE id = ?” operations and convert them into one “… WHERE id IN (…)”. Sounds like a great use of your time.

    In the end you might think to yourself “why am I doing this, when my SQL database already has query optimisation?”. And it’s a fair question, you are onto it. Try one of those auto-GraphQL things instead. EdgeDB (https://edgedb.com) does it as we speak, runs atop Postgres. Save yourself the enormous effort if you’re only building a GraphQL API for a single RBDMS, and not as a façade for a cluster of microservices and databases and external requests.

    Or just nod to your boss and go back to what being a backend developer has always meant: laboriously building by hand completely ad hoc JSON versions of SQL RBDMS schemas, each terribly unhappy in its own way. In no way does doing it manually but presenting GraphQL deviate from this Sisyphean tradition.

    I read in the article that NOT having GraphQL exactly match your DB schema is a best practice. My response is “did a backend developer write this?”

  • TinyDB

    TinyDB is a lightweight document oriented database optimized for your happiness :)

    Project mention: BetterJSONStorage - faster 'Storage Type' for TinyDB. | reddit.com/r/Python | 2022-03-07

    BetterJSONStorage is a faster 'Storage Type' for TinyDB. It uses treading, the faster Orjson library for parsing the JSON and BLOSC2 for compression.

  • dataset

    Easy-to-use data handling for SQL data stores with support for implicit table creation, bulk loading, and transactions.

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • tencent-ml-images

    Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet

    Project mention: [D] What open-source dataset lacks annotations? | reddit.com/r/MachineLearning | 2021-12-20

  • flask-base

    A simple Flask boilerplate app with SQLAlchemy, Redis, User Authentication, and more.

    Project mention: Wrong dashboard while adding flask-admin to project | reddit.com/r/codehunter | 2022-03-14

    I'm trying to extend the flask-base project https://github.com/hack4impact/flask-base/tree/master/app. This uses the the application factory pattern in app/init.py and blueprints.

  • arctic

    High performance datastore for time series and tick data

    Project mention: arctic: NEW Data - star count:2686.0 | reddit.com/r/algoprojects | 2022-05-21

  • pyodbc

    Python ODBC bridge

    Project mention: ODBC and OLE DB connections "going stale" after several hours | reddit.com/r/sysadmin | 2022-05-26

    I am trying to migrate data from our Enterprise Data Warehouse to one of our own reporting databases via ODBC and Python scripts. The python scripts import pyodbc to handle the database connections and execute SQL queries. A system DSN is defined on our ETL server for each database involved in the process.

  • Flask-Migrate

    SQLAlchemy database migrations for Flask applications using Alembic

    Project mention: Building a Todo List Application with Flask | dev.to | 2021-11-23

    You'll need to install the Flask-SQLAlchemy and Flask-Migrate extensions which will map all the data in your application to the sqlite db and also handle database migrations.

  • sandman2

    Automatically generate a RESTful API service for your legacy database. No code required!

    Project mention: PostgREST v9.0.0 | news.ycombinator.com | 2021-11-29

    I'm using sandman2[0] as a wrapper for psql and mysql databases. how is it different or any feature/differentiating factor I should consider for my future wrappers?

    [0] - https://github.com/jeffknupp/sandman2

  • ibis

    Expressive analytics in Python at any scale. (by ibis-project)

    Project mention: This Week in Python | dev.to | 2022-03-25

    ibis – Python data analysis framework for Hadoop and SQL engines

  • PyPika

    PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.

    Project mention: Write an SQL query builder in 150 lines of Python | news.ycombinator.com | 2021-08-27

    https://github.com/kayak/pypika

    Have used in multiple projects and have found it's the right balance between ORMs and writing raw SQL. It's also easily extensible and takes care of the many edge cases and nuances of rolling your own SQL generator.

  • CloudFail

    Utilize misconfigured DNS and old database records to find hidden IP's behind the CloudFlare network

    Project mention: Awesome Penetration Testing | dev.to | 2021-10-06

    CloudFail - Unmask server IP addresses hidden behind Cloudflare by searching old database records and detecting misconfigured DNS.

  • codechecker

    CodeChecker is an analyzer tooling, defect database and viewer extension for the Clang Static Analyzer and Clang Tidy

    Project mention: IKOS: Static analyzer for C/C++ based on the theory of Abstract Interpretation | news.ycombinator.com | 2022-04-20

    Another open source alternative is CodeChecker [1] with the Clang static analyzer [2]. Make sure the Clang toolchain has been compiled with Z3 [3] support for better results (it's the case in Debian stable), particularly for code doing bit operations. It supports cross files analysis ("cross translation units" or CTU), which last time I checked was not the case for IKOS and helps improve diagnostics.

    It's not completely turn key if you use it for a cross compiled code base, but once set-up I prefer it to another professional tool: much less false alarms. Although it's good to have both, each one found issues not seen by the other.

      [1] https://github.com/Ericsson/codechecker

  • sqlite-web

    Web-based SQLite database browser written in Python

  • Orator

    The Orator ORM provides a simple yet beautiful ActiveRecord implementation.

    Project mention: 初探 Orator ORM | dev.to | 2021-11-14

  • mongoaudit

    🔥 A powerful MongoDB auditing and pentesting tool 🔥

  • mssql-cli

    A command-line client for SQL Server with auto-completion and syntax highlighting

  • FinanceDatabase

    This is a database of 300.000+ symbols containing Equities, ETFs, Funds, Indices, Currencies, Cryptocurrencies and Money Markets.

    Project mention: FinanceDatabase: NEW Derivatives and Hedging - star count:1051.0 | reddit.com/r/algoprojects | 2022-05-14

  • walrus

    Lightweight Python utilities for working with Redis

    Project mention: Kvrocks: NoSQL database based on RocksDB and compatible with Redis protocol | reddit.com/r/redis | 2021-11-12

    I remember testing a bunch of redis clones and found the following test suite quite good: https://github.com/coleifer/walrus/tree/master/walrus/tests

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-05-26.

Python Database related posts

Index

What are some of the best open-source Database projects in Python? This list will help you:

Project Stars
1 SQLMap 23,548
2 pgcli 10,371
3 mycli 10,351
4 q 9,062
5 edgedb 7,775
6 TinyDB 5,075
7 dataset 4,159
8 tencent-ml-images 2,974
9 flask-base 2,753
10 arctic 2,699
11 pyodbc 2,388
12 Flask-Migrate 2,053
13 sandman2 1,825
14 ibis 1,822
15 PyPika 1,651
16 CloudFail 1,595
17 codechecker 1,539
18 sqlite-web 1,505
19 Orator 1,338
20 mongoaudit 1,238
21 mssql-cli 1,194
22 FinanceDatabase 1,066
23 walrus 985
Find remote jobs at our new job board 99remotejobs.com. There are 7 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com