Python MySQL

Open-source Python projects categorized as MySQL

Top 23 Python MySQL Projects

  • Redash

    Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

    Project mention: FLaNK Stack 26 February 2024 | dev.to | 2024-02-26
  • MindsDB

    The platform for building custom AI, enabling smarter organizations.

    Project mention: Fine-tuning a Mistral Language Model with Anyscale | dev.to | 2024-02-01

    MindsDB is an open-source AI platform for developers that connects AI/ML models with real-time data. It provides tools and automation to easily build and maintain personalized AI solutions.

  • WorkOS

    The modern API for authentication & user identity. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • airbyte

    The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

    Project mention: Launch HN: Bracket (YC W22) – Two-Way Sync Between Salesforce and Postgres | news.ycombinator.com | 2023-12-12

    I'l also give a shout-out to Airbyte (https://airbyte.com/), with which I've had some limited success with integrating Salesforce to a local database. The particular pull for Airbyte is that we can self-host the open source version, rather than pay Fivetran a significant sum to do this for us.

    It's an immature tool, so I don't yet know that I can claim we've spent _less_ than Fivetran on the additional engineering and ops time, but it feels like it has potential to do so once stabilized.

  • mycli

    A Terminal Client for MySQL with AutoCompletion and Syntax Highlighting.

    Project mention: Does anyone prefer the CLI over the shell, or other way around? If so, why? | /r/mysql | 2023-04-23

    Also, check out MyCLI. https://github.com/dbcli/mycli "Terminal Client for MySQL with AutoCompletion and Syntax Highlighting"

  • PyMySQL

    MySQL client library for Python

  • dev-setup

    macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

  • sqlglot

    Python SQL Parser and Transpiler

    Project mention: Build the dependency graph of your BigQuery pipelines at no cost: a Python implementation | dev.to | 2024-01-11

    In the project we used Python lib networkx and a DiGraph object (Direct Graph). To detect a table reference in a Query, we use sqlglot, a SQL parser (among other things) that works well with Bigquery.

  • LearnThisRepo.com

    Learn 300+ open source libraries for free using AI. LearnThisRepo lets you learn 300+ open source repos including Postgres, Langchain, VS Code, and more by chatting with them using AI!

  • tortoise-orm

    Familiar asyncio ORM for python, built with relations in mind

    Project mention: How to Connect a FastAPI Server to PostgreSQL and Deploy on GCP Cloud Run | dev.to | 2023-05-26

    To do this, we can use the Tortoise-ORM. Begin by installing the package:

  • ibis

    The flexibility of Python with the scale and performance of modern SQL.

    Project mention: FLaNK Stack 26 February 2024 | dev.to | 2024-02-26
  • AWS Data Wrangler

    pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

    Project mention: Read files from s3 using Pandas/s3fs or AWS Data Wrangler? | /r/dataengineering | 2023-12-06

    I had no problem with awswrangler (https://github.com/aws/aws-sdk-pandas) and it supports reading and writing partitions which was really helpful and a few other optimizations that made it a great tool

  • databases

    Async database support for Python. 🗄

    Project mention: Whats the standard way for interacting with a DB. | /r/FastAPI | 2023-03-15
  • PonyORM

    Pony Object Relational Mapper

  • data-diff

    Compare tables within or across databases

    Project mention: How to Check 2 SQL Tables Are the Same | news.ycombinator.com | 2023-07-26

    If the issue happen a lot, there is also: https://github.com/datafold/data-diff

    That is a nice tool to do it cross database as well.

    I think it's based on checksum method.

  • Gopherus

    This tool generates gopher link for exploiting SSRF and gaining RCE in various servers

  • mysqlclient

    MySQL database connector for Python (with Python 3 support)

    Project mention: Can't install mysqclient in python 3.12 | /r/django | 2023-12-06

    for your reference: https://github.com/PyMySQL/mysqlclient/issues/672

  • python-mysql-replication

    Pure Python Implementation of MySQL replication protocol build on top of PyMYSQL

    Project mention: Is anyone using PyPy for real work? | news.ycombinator.com | 2023-07-31

    I'm maintaining an internal change-data-capture application that uses a python library to decode mysql binlog and store the change records as json in the data lake (like Debezium). For our most busiest databases a single Cpython process couldn't process the amount of incoming changes in real time (thousands of events per second). It's not something that can be easily parallelized, as the bulk of the work is happening in the binlog decoding library (https://github.com/julien-duponchelle/python-mysql-replicati...).

    So we've made it configurable to run some instances with Pypy - which was able to work through the data in realtime, i.e. without generating a lag in the data stream. The downside of using pypy was increased memory usage (4-8x) - which isn't really a problem. An actually problem that I didn't really track down was that the test suite (running pytest) was taking 2-3 times longer with Pypy than with CPython.

    A few months ago I upgraded the system to run with CPython 3.11 and the performance improvements of 10-20% that come with that version now actually allowed us to drop Pypy and only run CPython. Which is more convenient and makes the deployment and configuration less complex.

  • aiomysql

    aiomysql is a library for accessing a MySQL database from the asyncio

  • learning

    Learning Shell,Python,Golang,System,Network (by anzhihe)

  • borgmatic

    Simple, configuration-driven backup software for servers and workstations

    Project mention: Rclone syncs your files to cloud storage | news.ycombinator.com | 2024-01-26

    - for important files, a separate box where I have borgmatic [1] in deduplication mode installed; this is updated once in a while

    Just curious: Do you have any reason to believe that such a data corruption bug is likely in ZFS? It seems like saying that ext4 could have a bug and you should also store stuff on NTFS, just in case (which I think does not make sense..).

    [1]: https://github.com/borgmatic-collective/borgmatic

  • prisma-client-py

    Prisma Client Python is an auto-generated and fully type-safe database client designed for ease of use

    Project mention: Sunday Daily Thread: What's everyone working on this week? | /r/Python | 2023-04-16

    almost samezies, although I'm trying prisma-client-py for team-specific reasons.

  • fapro

    Fake Protocol Server

  • nagios-plugins

    450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

  • eralchemy

    Entity Relation Diagrams generation tool

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-02-26.

Python MySQL related posts

Index

What are some of the best open-source MySQL projects in Python? This list will help you:

Project Stars
1 Redash 24,629
2 MindsDB 20,007
3 airbyte 13,265
4 mycli 11,196
5 PyMySQL 7,500
6 dev-setup 6,032
7 sqlglot 4,935
8 tortoise-orm 4,131
9 ibis 3,751
10 AWS Data Wrangler 3,745
11 databases 3,655
12 PonyORM 3,473
13 data-diff 2,755
14 Gopherus 2,584
15 mysqlclient 2,379
16 python-mysql-replication 2,247
17 aiomysql 1,681
18 learning 1,642
19 borgmatic 1,590
20 prisma-client-py 1,496
21 fapro 1,483
22 nagios-plugins 1,114
23 eralchemy 1,066
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com