Python Database

Open-source Python projects categorized as Database

Top 23 Python Database Projects

  • SQLMap

    Automatic SQL injection and database takeover tool

    Project mention: Best Hacking Tools for Beginners 2024 | dev.to | 2024-02-01

    sqlmap

  • MindsDB

    The platform for customizing AI from enterprise data

    Project mention: What’s the Difference Between Fine-tuning, Retraining, and RAG? | dev.to | 2024-04-08

    Check us out on GitHub.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • edgedb

    A graph-relational database with declarative schema, built-in migration system, and a next-generation query language

    Project mention: EdgeDB – A graph-relational database with declarative schema | news.ycombinator.com | 2024-02-10
  • pgcli

    Postgres CLI with autocompletion and syntax highlighting

  • mycli

    A Terminal Client for MySQL with AutoCompletion and Syntax Highlighting.

    Project mention: Does anyone prefer the CLI over the shell, or other way around? If so, why? | /r/mysql | 2023-04-23

    Also, check out MyCLI. https://github.com/dbcli/mycli "Terminal Client for MySQL with AutoCompletion and Syntax Highlighting"

  • DB-GPT

    AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

    Project mention: (2/2) May 2023 | /r/dailyainews | 2023-06-02

    Interact your data and environment using the local GPT (https://github.com/csunny/DB-GPT)

  • q

    q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • TinyDB

    TinyDB is a lightweight document oriented database optimized for your happiness :)

  • dataset

    Easy-to-use data handling for SQL data stores with support for implicit table creation, bulk loading, and transactions.

  • ibis

    the portable Python dataframe library

    Project mention: This Week In Python | dev.to | 2024-03-17

    ibis – portable Python dataframe library

  • tencent-ml-images

    Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet

  • arctic

    High performance datastore for time series and tick data

    Project mention: arctic: NEW Data - star count:2988.0 | /r/algoprojects | 2023-08-08
  • flask-base

    A simple Flask boilerplate app with SQLAlchemy, Redis, User Authentication, and more.

  • sqlite-web

    Web-based SQLite database browser written in Python

    Project mention: This Week In Python | dev.to | 2024-03-02

    sqlite-web – Web-based SQLite database browser written in Python

  • data-diff

    Compare tables within or across databases

    Project mention: How to Check 2 SQL Tables Are the Same | news.ycombinator.com | 2023-07-26

    If the issue happen a lot, there is also: https://github.com/datafold/data-diff

    That is a nice tool to do it cross database as well.

    I think it's based on checksum method.

  • evadb

    Database system for AI-powered apps

    Project mention: Show HN: Stargazers Reloaded – LLM-Powered Analyses of Your GitHub Community | news.ycombinator.com | 2023-09-30

    Hey friends!

    We have built an app for getting insights about your favorite GitHub community using large language models.

    The app uses LLMs to analyze the GitHub profiles of users who have starred the repository, capturing key details like the topics they are interested in. It takes screenshots of the stargazer's GitHub webpage, extracts text using an OCR model, and extracts insights embedded in the extracted text using LLMs.

    This app is inspired by the “original” Stargazers app written by Spencer Kimball (CEO of CockroachDB). While the original app exclusively used the GitHub API, this LLM-powered app built using EvaDB additionally extracts insights from unstructured data obtained from the stargazers’ webpages.

    Our analysis of the fast-growing GPT4All community showed that the majority of the stargazers are proficient in Python and JavaScript, and 43% of them are interested in Web Development. Web developers love open-source LLMs!

    We found that directly using GPT-4 to generate the “golden” table is super expensive — costing $60 to process the information of 1000 stargazers. To maintain accuracy while also reducing cost, we set up an LLM model cascade in a SQL query, running GPT-3.5 before GPT-4, that lowers the cost to $5.5 for analyzing 1000 GitHub stargazers.

    We’ve been working on this app for a month now and are excited to open source it today :)

    Some useful links:

    * Blog Post - https://medium.com/evadb-blog/stargazers-reloaded-llm-powere...

    * GitHub Repository - https://github.com/pchunduri6/stargazers-reloaded/

    * EvaDB - https://github.com/georgia-tech-db/evadb

    Please let us know what you think!

  • PyPika

    PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.

    Project mention: any recommendations for a good query builder library with good support? | /r/learnpython | 2023-07-11

    I recently started using drizzle orm and I am now looking for something similar in python, my goal is to be as close to sql syntax as possible without just passing dml commands as strings, type safety would be cool as well, I saw this one pypika but it ha a lot of open issues and no commits for a year, is there anything similar but more stable?

  • Flask-Migrate

    SQLAlchemy database migrations for Flask applications using Alembic

  • CloudFail

    Utilize misconfigured DNS and old database records to find hidden IP's behind the CloudFlare network

  • codechecker

    CodeChecker is an analyzer tooling, defect database and viewer extension for the Clang Static Analyzer and Clang Tidy

  • pgadmin4

    pgAdmin is the most popular and feature rich Open Source administration and development platform for PostgreSQL, the most advanced Open Source database in the world.

    Project mention: PostgreSQL on WSL (Debian) | dev.to | 2024-04-15

    You can install pgAdmin on Windows and connect the GUI Admin/developer tool directly to your PostgreSQL server running in WSL.

  • baserow

    The official repository is hosted on https://gitlab.com/bramw/baserow. Baserow is an open source no-code database tool and Airtable alternative.

    Project mention: Baserow – Self Hosted Airtable Alternative Launches No-Code Application Builder | news.ycombinator.com | 2024-03-13

    Hey, I'm one of the founders of Baserow. We launched the beta of our application builder last week. It allows you to build database-driven websites, web applications, and portals. It's in the same product as our database module, and will work seamlessly together with it. More information can be found in the release blog post linked to this post, and in this video https://www.youtube.com/watch?v=yjE7gxkPlDs. Even though it's in an early state, it's already possible to try it out on https://baserow.io or by self-hosting the latest version. Happy to answer all the questions you might have.

  • sandman2

    Automatically generate a RESTful API service for your legacy database. No code required!

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-04-15.

Python Database related posts

Index

What are some of the best open-source Database projects in Python? This list will help you:

Project Stars
1 SQLMap 30,427
2 MindsDB 21,160
3 edgedb 12,180
4 pgcli 11,678
5 mycli 11,246
6 DB-GPT 10,715
7 q 10,106
8 TinyDB 6,488
9 dataset 4,716
10 ibis 4,041
11 tencent-ml-images 3,043
12 arctic 3,028
13 flask-base 2,976
14 sqlite-web 2,867
15 data-diff 2,824
16 evadb 2,564
17 PyPika 2,360
18 Flask-Migrate 2,292
19 CloudFail 2,110
20 codechecker 2,079
21 pgadmin4 2,056
22 baserow 2,036
23 sandman2 1,981
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com