Python Database

Open-source Python projects categorized as Database

Top 23 Python Database Projects

  • SQLMap

    Automatic SQL injection and database takeover tool

  • Project mention: Best Hacking Tools for Beginners 2024 | dev.to | 2024-02-01

    sqlmap

  • MindsDB

    The platform for customizing AI from enterprise data

  • Project mention: What’s the Difference Between Fine-tuning, Retraining, and RAG? | dev.to | 2024-04-08

    Check us out on GitHub.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • edgedb

    A graph-relational database with declarative schema, built-in migration system, and a next-generation query language

  • Project mention: EdgeDB – A graph-relational database with declarative schema | news.ycombinator.com | 2024-02-10
  • pgcli

    Postgres CLI with autocompletion and syntax highlighting

  • mycli

    A Terminal Client for MySQL with AutoCompletion and Syntax Highlighting.

  • DB-GPT

    AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

  • Project mention: (2/2) May 2023 | /r/dailyainews | 2023-06-02

    Interact your data and environment using the local GPT (https://github.com/csunny/DB-GPT)

  • pandas-ai

    Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.

  • Project mention: PandasAI is great but is there a more general library? | news.ycombinator.com | 2023-08-23
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • q

    q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)

  • TinyDB

    TinyDB is a lightweight document oriented database optimized for your happiness :)

  • dataset

    Easy-to-use data handling for SQL data stores with support for implicit table creation, bulk loading, and transactions.

  • ibis

    the portable Python dataframe library

  • Project mention: Show HN: Hashquery, a Python library for defining reusable analysis | news.ycombinator.com | 2024-04-23

    I really don't understand the appeal of dbt vs a proper programming language. The templating approach leads to massive spaghetti. I look forward to trying out something like Ibis [0]

    0: https://ibis-project.org/

  • tencent-ml-images

    Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet

  • arctic

    High performance datastore for time series and tick data

  • Project mention: arctic: NEW Data - star count:2988.0 | /r/algoprojects | 2023-08-08
  • flask-base

    A simple Flask boilerplate app with SQLAlchemy, Redis, User Authentication, and more.

  • sqlite-web

    Web-based SQLite database browser written in Python

  • Project mention: This Week In Python | dev.to | 2024-03-02

    sqlite-web – Web-based SQLite database browser written in Python

  • data-diff

    Compare tables within or across databases

  • Project mention: How to Check 2 SQL Tables Are the Same | news.ycombinator.com | 2023-07-26

    If the issue happen a lot, there is also: https://github.com/datafold/data-diff

    That is a nice tool to do it cross database as well.

    I think it's based on checksum method.

  • evadb

    Database system for AI-powered apps

  • Project mention: Show HN: Stargazers Reloaded – LLM-Powered Analyses of Your GitHub Community | news.ycombinator.com | 2023-09-30

    Hey friends!

    We have built an app for getting insights about your favorite GitHub community using large language models.

    The app uses LLMs to analyze the GitHub profiles of users who have starred the repository, capturing key details like the topics they are interested in. It takes screenshots of the stargazer's GitHub webpage, extracts text using an OCR model, and extracts insights embedded in the extracted text using LLMs.

    This app is inspired by the “original” Stargazers app written by Spencer Kimball (CEO of CockroachDB). While the original app exclusively used the GitHub API, this LLM-powered app built using EvaDB additionally extracts insights from unstructured data obtained from the stargazers’ webpages.

    Our analysis of the fast-growing GPT4All community showed that the majority of the stargazers are proficient in Python and JavaScript, and 43% of them are interested in Web Development. Web developers love open-source LLMs!

    We found that directly using GPT-4 to generate the “golden” table is super expensive — costing $60 to process the information of 1000 stargazers. To maintain accuracy while also reducing cost, we set up an LLM model cascade in a SQL query, running GPT-3.5 before GPT-4, that lowers the cost to $5.5 for analyzing 1000 GitHub stargazers.

    We’ve been working on this app for a month now and are excited to open source it today :)

    Some useful links:

    * Blog Post - https://medium.com/evadb-blog/stargazers-reloaded-llm-powere...

    * GitHub Repository - https://github.com/pchunduri6/stargazers-reloaded/

    * EvaDB - https://github.com/georgia-tech-db/evadb

    Please let us know what you think!

  • PyPika

    PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.

  • Project mention: any recommendations for a good query builder library with good support? | /r/learnpython | 2023-07-11

    I recently started using drizzle orm and I am now looking for something similar in python, my goal is to be as close to sql syntax as possible without just passing dml commands as strings, type safety would be cool as well, I saw this one pypika but it ha a lot of open issues and no commits for a year, is there anything similar but more stable?

  • Flask-Migrate

    SQLAlchemy database migrations for Flask applications using Alembic

  • pgadmin4

    pgAdmin is the most popular and feature rich Open Source administration and development platform for PostgreSQL, the most advanced Open Source database in the world.

  • Project mention: Using migrations with Golang | dev.to | 2024-04-17

    If we access a client like PgAdmin or Beekeeper, or accessing its container via bash and checking via CLI, we can see that the table was created successfully:

  • CloudFail

    Utilize misconfigured DNS and old database records to find hidden IP's behind the CloudFlare network

  • codechecker

    CodeChecker is an analyzer tooling, defect database and viewer extension for the Clang Static Analyzer and Clang Tidy

  • baserow

    The official repository is hosted on https://gitlab.com/bramw/baserow. Baserow is an open source no-code database tool and Airtable alternative.

  • Project mention: Baserow – Self Hosted Airtable Alternative Launches No-Code Application Builder | news.ycombinator.com | 2024-03-13

    Hey, I'm one of the founders of Baserow. We launched the beta of our application builder last week. It allows you to build database-driven websites, web applications, and portals. It's in the same product as our database module, and will work seamlessly together with it. More information can be found in the release blog post linked to this post, and in this video https://www.youtube.com/watch?v=yjE7gxkPlDs. Even though it's in an early state, it's already possible to try it out on https://baserow.io or by self-hosting the latest version. Happy to answer all the questions you might have.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Database related posts

  • The Impact of API Response Time on Performance: What You Need to Know

    2 projects | dev.to | 16 May 2024
  • Collection of publicly available IPTV channels from all over the world

    3 projects | news.ycombinator.com | 29 Apr 2024
  • Show HN: Hashquery, a Python library for defining reusable analysis

    1 project | news.ycombinator.com | 23 Apr 2024
  • Loading a trillion rows of weather data into TimescaleDB

    8 projects | news.ycombinator.com | 16 Apr 2024
  • PostgreSQL on WSL (Debian)

    1 project | dev.to | 15 Apr 2024
  • Time Series Blob Data: ReductStore vs. MongoDB

    4 projects | dev.to | 8 Apr 2024
  • PgAdmin PostgreSQL Tools

    1 project | news.ycombinator.com | 30 Mar 2024
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 18 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Database projects in Python? This list will help you:

Project Stars
1 SQLMap 30,736
2 MindsDB 21,424
3 edgedb 12,623
4 pgcli 11,746
5 mycli 11,282
6 DB-GPT 11,202
7 pandas-ai 11,140
8 q 10,127
9 TinyDB 6,552
10 dataset 4,721
11 ibis 4,304
12 tencent-ml-images 3,048
13 arctic 3,036
14 flask-base 2,990
15 sqlite-web 2,937
16 data-diff 2,865
17 evadb 2,582
18 PyPika 2,386
19 Flask-Migrate 2,307
20 pgadmin4 2,167
21 CloudFail 2,153
22 codechecker 2,110
23 baserow 2,094

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com