Top 23 Python Database Projects
-
Actually python is powerful enough for developing hacking tools, just as Routersploit, SQLMap etc.
-
Project mention: Postgres: ERROR: column d.adsrc does not exist | reddit.com/r/PostgreSQL | 2022-05-23
Home: http://pgcli.com
-
Scout APM
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
-
-
Project mention: OpenOffice. Necesito ver una hoja de cálculo que tiene 6 millones de columnas, pero no puedo | reddit.com/r/AskArgentina | 2022-05-15
-
You have to do your own optimiser to avoid, for instance, the N+1 query problem. (Just Google that, plenty of explanations around.) Many GraphQL frameworks have a “naive” subquery implementation that performs N individual subqueries. You either have to override this for each parent/child pairing, or bolt something on the back to delay all the “SELECT * FROM tbl_subquery WHERE id = ?” operations and convert them into one “… WHERE id IN (…)”. Sounds like a great use of your time.
In the end you might think to yourself “why am I doing this, when my SQL database already has query optimisation?”. And it’s a fair question, you are onto it. Try one of those auto-GraphQL things instead. EdgeDB (https://edgedb.com) does it as we speak, runs atop Postgres. Save yourself the enormous effort if you’re only building a GraphQL API for a single RBDMS, and not as a façade for a cluster of microservices and databases and external requests.
Or just nod to your boss and go back to what being a backend developer has always meant: laboriously building by hand completely ad hoc JSON versions of SQL RBDMS schemas, each terribly unhappy in its own way. In no way does doing it manually but presenting GraphQL deviate from this Sisyphean tradition.
I read in the article that NOT having GraphQL exactly match your DB schema is a best practice. My response is “did a backend developer write this?”
-
Project mention: BetterJSONStorage - faster 'Storage Type' for TinyDB. | reddit.com/r/Python | 2022-03-07
BetterJSONStorage is a faster 'Storage Type' for TinyDB. It uses treading, the faster Orjson library for parsing the JSON and BLOSC2 for compression.
-
dataset
Easy-to-use data handling for SQL data stores with support for implicit table creation, bulk loading, and transactions.
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
tencent-ml-images
Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet
Project mention: [D] What open-source dataset lacks annotations? | reddit.com/r/MachineLearning | 2021-12-20 -
Project mention: Wrong dashboard while adding flask-admin to project | reddit.com/r/codehunter | 2022-03-14
I'm trying to extend the flask-base project https://github.com/hack4impact/flask-base/tree/master/app. This uses the the application factory pattern in app/init.py and blueprints.
-
-
Project mention: ODBC and OLE DB connections "going stale" after several hours | reddit.com/r/sysadmin | 2022-05-26
I am trying to migrate data from our Enterprise Data Warehouse to one of our own reporting databases via ODBC and Python scripts. The python scripts import pyodbc to handle the database connections and execute SQL queries. A system DSN is defined on our ETL server for each database involved in the process.
-
You'll need to install the Flask-SQLAlchemy and Flask-Migrate extensions which will map all the data in your application to the sqlite db and also handle database migrations.
-
I'm using sandman2[0] as a wrapper for psql and mysql databases. how is it different or any feature/differentiating factor I should consider for my future wrappers?
-
ibis – Python data analysis framework for Hadoop and SQL engines
-
PyPika
PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.
Project mention: Write an SQL query builder in 150 lines of Python | news.ycombinator.com | 2021-08-27https://github.com/kayak/pypika
Have used in multiple projects and have found it's the right balance between ORMs and writing raw SQL. It's also easily extensible and takes care of the many edge cases and nuances of rolling your own SQL generator.
-
CloudFail
Utilize misconfigured DNS and old database records to find hidden IP's behind the CloudFlare network
CloudFail - Unmask server IP addresses hidden behind Cloudflare by searching old database records and detecting misconfigured DNS.
-
codechecker
CodeChecker is an analyzer tooling, defect database and viewer extension for the Clang Static Analyzer and Clang Tidy
Project mention: IKOS: Static analyzer for C/C++ based on the theory of Abstract Interpretation | news.ycombinator.com | 2022-04-20Another open source alternative is CodeChecker [1] with the Clang static analyzer [2]. Make sure the Clang toolchain has been compiled with Z3 [3] support for better results (it's the case in Debian stable), particularly for code doing bit operations. It supports cross files analysis ("cross translation units" or CTU), which last time I checked was not the case for IKOS and helps improve diagnostics.
It's not completely turn key if you use it for a cross compiled code base, but once set-up I prefer it to another professional tool: much less false alarms. Although it's good to have both, each one found issues not seen by the other.
[1] https://github.com/Ericsson/codechecker
-
-
-
-
-
FinanceDatabase
This is a database of 300.000+ symbols containing Equities, ETFs, Funds, Indices, Currencies, Cryptocurrencies and Money Markets.
Project mention: FinanceDatabase: NEW Derivatives and Hedging - star count:1051.0 | reddit.com/r/algoprojects | 2022-05-14 -
Project mention: Kvrocks: NoSQL database based on RocksDB and compatible with Redis protocol | reddit.com/r/redis | 2021-11-12
I remember testing a bunch of redis clones and found the following test suite quite good: https://github.com/coleifer/walrus/tree/master/walrus/tests
Python Database related posts
- ODBC and OLE DB connections "going stale" after several hours
- Most popular PostgreSQL GUIs in 2022: the (almost) scientific list
- File format for large data with many columns
- SQLite cron-based backup (alternative to Litestream for simpler usecases)
- FinanceDatabase: NEW Derivatives and Hedging - star count:1051.0
- FinanceDatabase: NEW Derivatives and Hedging - star count:1051.0
- FinanceDatabase: NEW Derivatives and Hedging - star count:1051.0
Index
What are some of the best open-source Database projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | SQLMap | 23,548 |
2 | pgcli | 10,371 |
3 | mycli | 10,351 |
4 | q | 9,062 |
5 | edgedb | 7,775 |
6 | TinyDB | 5,075 |
7 | dataset | 4,159 |
8 | tencent-ml-images | 2,974 |
9 | flask-base | 2,753 |
10 | arctic | 2,699 |
11 | pyodbc | 2,388 |
12 | Flask-Migrate | 2,053 |
13 | sandman2 | 1,825 |
14 | ibis | 1,822 |
15 | PyPika | 1,651 |
16 | CloudFail | 1,595 |
17 | codechecker | 1,539 |
18 | sqlite-web | 1,505 |
19 | Orator | 1,338 |
20 | mongoaudit | 1,238 |
21 | mssql-cli | 1,194 |
22 | FinanceDatabase | 1,066 |
23 | walrus | 985 |
Are you hiring? Post a new remote job listing for free.