yugabyte-db
psycopg2
Our great sponsors
yugabyte-db | psycopg2 | |
---|---|---|
87 | 19 | |
8,471 | 3,205 | |
1.1% | 1.6% | |
10.0 | 7.2 | |
6 days ago | 22 days ago | |
C | C | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
yugabyte-db
-
Best Practice: use the same datatypes for comparisons, like joins and foreign keys
It is possible to apply Batched Nested Loop but with additional code that checks the range of the outer bigint and compare it only if it matches the range of integer. This has been added in YugabyteDB 2.21 with #20715 YSQL: Allow BNL on joins over different integer types to help migrations from PostgreSQL with such datatype inconsistencies.
-
Jonathan Katz: Thoughts on PostgreSQL in 2024
It can be done like https://github.com/yugabyte/yugabyte-db/ has.
-
Is co-partition or interleave necessary in Distributed SQL?
Therefore, interleaving or co-partitioning is probably not necessary, and would reduce agility and scalability more than improving the performance. Unless you have a good reason for it that you can share on Issue #79. But, first, test and tune the queries to see if you need something else.
-
PostGIS on YugabyteDB Alma8 (workarounds)
This is a workaround, not supported. I've opened the following issue to get it solve in the YugabyteDB deployment: https://github.com/yugabyte/yugabyte-db/issues/19389
-
Bitmap Scan in YugabyteDB
Note that there may still be a need for bitmaps, especially with disjunctions (OR) as the following is about conjunction (AND), and it can still be implemented, differently than PostgreSQL. This is tracked by #4634.
- Yugabyte – distributed PostgreSQL, 100% open source
-
PL/Python on YugabyteDB
FROM almalinux:8 as build RUN dnf -y update &&\ dnf groupinstall -y 'Development Tools' # get YugabyteDB sources ARG YB_TAG=2.18 RUN git clone --branch ${YB_TAG} https://github.com/yugabyte/yugabyte-db.git WORKDIR yugabyte-db # install dependencies and compilation tools RUN dnf install -y https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm RUN dnf -y install epel-release libatomic rsync python3-devel cmake3 java-1.8.0-openjdk maven npm golang gcc-toolset-12 gcc-toolset-12-libatomic-devel patchelf glibc-langpack-en ccache vim wget python3.11-devel python3.11-pip clang ncurses-devel readline-devel libsqlite3x-devel RUN mkdir /opt/yb-build RUN chown "$USER" /opt/yb-build # Install Python 3 RUN alternatives --remove-all python3 RUN alternatives --remove-all python RUN alternatives --install /usr/bin/python python /usr/bin/python3.11 3 RUN alternatives --install /usr/bin/python3 python3 /usr/bin/python3.11 3 # add #include "pg_yb_utils.h" to src/postgres/src/pl/plpython/plpy_procedure.c RUN sed -e '/#include "postgres.h"/a#include "pg_yb_utils.h"' -i src/postgres/src/pl/plpython/plpy_procedure.c # if using python > 3.9 remove #include and #include from src/postgres/src/pl/plpython/plpython.h RUN sed -e '/#include /d' -e '/#include /d' -i src/postgres/src/pl/plpython/plpython.h # add '--with-python', to python/yugabyte/build_postgres.py under the configure_postgres method RUN sed -e "/'\.\/configure',/a\ '--with-python'," -i python/yugabyte/build_postgres.py # Build and package the release RUN YB_CCACHE_DIR="$HOME/.cache/yb_ccache" ./yb_build.sh -j$(nproc) --clean-all --build-yugabyted-ui --no-linuxbrew --clang15 -f release RUN chmod +x bin/get_clients.sh bin/parse_contention.py bin/yb-check-consistency.py RUN YB_USE_LINUXBREW=0 ./yb_release --force WORKDIR / RUN mv /yugabyte-db/build/yugabyte*.tar.gz /yugabyte.tgz
-
YugabyteDB official Dockerfile
You have seen me using the official YugabyteDB Docker image extensively. This image is suitable for various purposes, including labs, development, testing, and even production. In the past, we used to create it internally due to its seamless integration with our build process. However, some companies prefer to construct the image on their own, which is indeed a commendable practice. After all, it's not advisable to run random images with root privileges on your servers. As a result, we have made a significant alteration by introducing a refined Dockerfile to our Github repository.
-
FlameGraphs on Steroids with profiler.firefox.com
Of course, I can guess from the function names, but YugabyteDB is Open Source and I can search for them. What happens here is that I didn't declare a Primary Key for my table and then an internal one (ybctid) is generated, because secondary indexes need a key to address the table row. This ID generation calls /dev/urandom. I made this simple example to show that low-level traces can give a clue about high level data model problems.
-
Understand what you run before publishing your (silly) benchmark results
To show that it is not difficut to understand what you run, when in a PostgreSQL-compatible database, I'll look at the HammerDB benchmark connected to YugabyteDB. HammerDB has no specific code for it but YugabyteDB is PostgreSQL-compatible (it uses PostgreSQL code on top of distributed storage and transaction).
psycopg2
-
Can I learn Python while practicing writing queries for SQL simultaneously? I've recently completed learning SQL and trying to get better at it.
You can practice both by using https://www.psycopg.org from your Python code to communicate with your database. When I wanted to practice some SQL, that's what I did (we use psycopg at work, so that's what I practiced with, making a dream journal thingy for myself that was better than just noting stuff in a notepad because I could then look up e.g. what other stuff was correlated with Y, how many times I dreamed of X, etc. etc.)
-
Installing psycopg2==2.8.6 throws an error
But seems like it should work with Django 3, which you have specified https://github.com/psycopg/psycopg2/issues/1293
-
Uploading CSVs to a SQL table using Python
If you're using Postgres for your SQL, look at the "copy' method of the psycopg module (see https://www.psycopg.org/articles/2020/11/15/psycopg3-copy/) . It's much faster than INSERTs in my experience (YMMV).
-
Underappreciated Challenges with Python Packaging
Back when I used Psycopg2, there was no -binary package, so you'd get libpq set up similarly to pg-native. Docs say:
> The binary package is a practical choice for development and testing but in production it is advised to use the package built from sources.
Relevant GitHub discussion: https://github.com/psycopg/psycopg2/issues/674
I dunno, this seems worse to me.
-
Integrate PostgreSQL Database In Python - A Hands-On Guide
Just go to the more easily readable docs here. I’m sorry, but the linked article is terrible.
-
Has anyone made the switch from developing in Windows to macOS? Any general or specific advice about the switch?
psycopg2-binary. See https://github.com/psycopg/psycopg2/issues/1286.
-
Dockerize a Django, React, and Postgres application with docker and docker-compose | by Anjal Bam
psycopg2-binary, PostgreSQL Database adapter for python.
-
My Cookiecutter Django Setup
... # psycopg2==2.9.3 # https://github.com/psycopg/psycopg2 ...
-
Why "import blescan as blescan"?
I sometimes do this in testing. For example, consider the library used to communicate with a Postgres database, psycopg.
- Engineers complaining about Docker for Mac?
What are some alternatives?
citus - Distributed PostgreSQL as an extension
asyncpg - A fast PostgreSQL Database Client Library for Python/asyncio.
cockroach - CockroachDB - the open source, cloud-native distributed SQL database.
queries - PostgreSQL database access simplified
neon - Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, branching, and bottomless storage.
SQLAlchemy - The Database Toolkit for Python
realtime - Broadcast, Presence, and Postgres Changes via WebSockets
PostgreSQL - Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see https://wiki.postgresql.org/wiki/Submitting_a_Patch
Apache AGE - Graph database optimized for fast analysis and real-time data processing. It is provided as an extension to PostgreSQL. [Moved to: https://github.com/apache/age]
txpostgres - Twisted wrapper for asynchronous PostgreSQL connections
postgres-ha - Postgres + Stolon for HA clusters as Fly apps.
awesome-mysql - A curated list of awesome MySQL software, libraries, tools and resources