InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises. Learn more →
Top 23 Python MySQL Projects
-
Redash
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
-
I picked a few of them on the hacktoberswag.com website. Precisely three: pusher.js, refine.dev, and MindsDB. You are probably asking Oh, you did not pick Wasp? The thing was, Wasp wasn’t listed on that web page and I didn’t know if any tool by that name existed.
-
InfluxDB
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.
-
-
Pymysql is the one i have seen being used most commonly. https://github.com/PyMySQL/PyMySQL
-
dev-setup
macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.
Something like this at least is the most direct answer to your question, as opposed to "you're doing it wrong" which unfortunately seems to be more upvoted. An example of something like this might be https://github.com/donnemartin/dev-setup
-
If I was answering this question but for python, I'd recommend something like prefect, boto3, or tortoise-orm -- not extremely complex and with a pretty comprehensible featureset.
-
AWS Data Wrangler
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Project mention: I agree that Arrow Tables are great, but we decided to keep the library focused on the Pandas interface. [wont implement] | reddit.com/r/programmingcirclejerk | 2022-09-21 -
Sonar
Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
-
In the code ,we are using SQLAlchemy as our ORM(Object Relational Mapper) and Databases as our query builder.
-
pony – Pony Object Relational Mapper
-
By the way I was introduced to Ibis https://github.com/ibis-project/ibis recently, I have mix feelings about it.
-
-
-
python-mysql-replication
Pure Python Implementation of MySQL replication protocol build on top of PyMYSQL
The BinLogStreamReader has several inputs that we need to retrieve. First we'll retrieve the cluster's secret with the database host/username/password and then we'll fetch the serverId we stored in S3.
-
I did data engineering for 6 years and am building a company to automate SQL validation for dbt users.
First, by “testing SQL pipelines”, I assume you mean testing changes to SQL code as part of the development workflow? (vs. monitoring pipelines in production for failures / anomalies).
If so:
1 – assertions. dbt comes with a solid built-in testing framework [1] for expressing assertions such as “this column should have values in the list [A,B,C]” as well checking referential integrity, uniqueness, nulls, etc. There are more advanced packages on top of dbt tests [2]. The problem with assertion testing in general though is that for a moderately complex data pipeline, it’s infeasible to achieve test coverage that would cover most possible failure scenarios.
2 – data diff: for every change to SQL, know exactly how the code change affects the output data by comparing the data in dev/staging (built off the dev branch code) with the data in production (built off the main branch). We built an open-source tool for that: https://github.com/datafold/data-diff, and we are adding an integration with dbt soon which will make diffing as part of dbt development workflow one command away [2]
We make money by selling a Cloud solution for teams that integrates data diff into Github/Gitlab CI and automatically diffs every pull request to tell you the how a change to SQL affects the target table you changed, downstream tables and dependent BI tools (video demo: [3])
I’ve also written about why reliable change management is so important for data engineering and what are key best practices to implement [4]
-
-
-
nagios-plugins
450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...
-
-
Project mention: Tools that help to explore and navigate database tables | reddit.com/r/dataengineering | 2022-11-21
sometging like this, maybe https://github.com/Alexis-benoist/eralchemy
-
prisma-client-py
Prisma Client Python is an auto-generated and fully type-safe database client designed for ease of use
Anyway, prisma is a relatively new project, and it is very pleasant to use. I encourage you to give it a try and support the python client (at least a star on GitHub). For me who doesn't like SQL, being able to retrieve models from the database and make queries with prisma is a breath of fresh air. 🤣
-
django-dbbackup
Management commands to help backup and restore your project database and media files
Project mention: Project for power companies - I might have bit more than I can chew | reddit.com/r/django | 2022-08-04And finally backups, this part is really important. When I was a beginner, I used to make silly mistakes which would lead me having to reset the entire database and rebuild. With backups you can simply restore back to a working point in time whenever something goes wrong. The django-dbbackup package can do this for you, however, you may run into a few issues which can be fixed. Or you could simply use PostgreSQL database dumps.
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-02-02.
Python MySQL related posts
- Ask HN: How do you test SQL?
- Data-diff v0.3: DuckDB, efficient in-database diffing and more
-
data-diff VS cuallee - a user suggested alternative
2 projects | 30 Nov 2022
- Compare identical tables across databases to identify data differences (Oracle 19c)
- A Deep Dive into Connecting FastAPI with SingleStore.
- Hacktoberfest Accepted Project with Vanilla Python 🚀 🌕
- Hacktoberfest Accepted Project with Vanilla Python 🚀 🌕
-
A note from our sponsor - InfluxDB
www.influxdata.com | 3 Feb 2023
Index
What are some of the best open-source MySQL projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | Redash | 22,545 |
| 2 | MindsDB | 12,526 |
| 3 | mycli | 10,732 |
| 4 | PyMySQL | 7,192 |
| 5 | dev-setup | 5,874 |
| 6 | tortoise-orm | 3,347 |
| 7 | AWS Data Wrangler | 3,305 |
| 8 | databases | 3,261 |
| 9 | PonyORM | 3,126 |
| 10 | ibis | 2,361 |
| 11 | mysqlclient | 2,175 |
| 12 | Gopherus | 2,174 |
| 13 | python-mysql-replication | 2,097 |
| 14 | data-diff | 2,076 |
| 15 | aiomysql | 1,549 |
| 16 | fapro | 1,377 |
| 17 | nagios-plugins | 1,083 |
| 18 | learning | 1,009 |
| 19 | eralchemy | 990 |
| 20 | prisma-client-py | 971 |
| 21 | django-dbbackup | 695 |
| 22 | aerich | 616 |
| 23 | django-mysql | 512 |
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com