python-mysql-replication

Pure Python Implementation of MySQL replication protocol build on top of PyMYSQL (by julien-duponchelle)
Add to my DEV experience MySQL Python mysql-replication-protocol mysql-binlog
Source Code
python-mysql-replication Reviews
Suggest alternative
Edit details
The modern identity platform for B2B SaaS
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com
Sponsored

Python-mysql-replication Alternatives

Similar projects and alternatives to python-mysql-replication

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better python-mysql-replication alternative or higher similarity.
Suggest an alternative to python-mysql-replication

python-mysql-replication reviews and mentions

Posts with mentions or reviews of python-mysql-replication. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-07-31.
  • Is anyone using PyPy for real work?
    13 projects | news.ycombinator.com | 31 Jul 2023
    I'm maintaining an internal change-data-capture application that uses a python library to decode mysql binlog and store the change records as json in the data lake (like Debezium). For our most busiest databases a single Cpython process couldn't process the amount of incoming changes in real time (thousands of events per second). It's not something that can be easily parallelized, as the bulk of the work is happening in the binlog decoding library (https://github.com/julien-duponchelle/python-mysql-replicati...).

    So we've made it configurable to run some instances with Pypy - which was able to work through the data in realtime, i.e. without generating a lag in the data stream. The downside of using pypy was increased memory usage (4-8x) - which isn't really a problem. An actually problem that I didn't really track down was that the test suite (running pytest) was taking 2-3 times longer with Pypy than with CPython.

    A few months ago I upgraded the system to run with CPython 3.11 and the performance improvements of 10-20% that come with that version now actually allowed us to drop Pypy and only run CPython. Which is more convenient and makes the deployment and configuration less complex.

  • Why Binlog size grows drastically when isolation level set to "Repeatable Read" & When isolation level set to "Read Committed" the size of Binlog file reduces ?
    1 project | /r/mysql | 21 Apr 2023
    doing the using Python, https://github.com/julien-duponchelle/python-mysql-replication, the recommended way of doing this
  • How to Use BinLogs to Make an Aurora MySQL Event Stream
    3 projects | dev.to | 3 Oct 2022
    The BinLogStreamReader has several inputs that we need to retrieve. First we'll retrieve the cluster's secret with the database host/username/password and then we'll fetch the serverId we stored in S3.
  • How is everyone ingesting backend relational data?
    1 project | /r/dataengineering | 28 Jul 2021
    From backend relational tables to data warehouses my team has mostly relied on change data capture replication. We use MySQL upstream, and historically used AWS DMS or Attunity Replicate to replicate directly to SQL server. Recently we made the switch to Snowflake, and used mostly AWS DMS to replicate CDC data to S3 (lists individual inserts, updates, deletes), and then from there use snowpipes to copy to snowflake and then a job to merge that data into the target table to get the latest state. In addition we've used this library in production https://github.com/noplay/python-mysql-replication, and still use it today for one high volume, critical data source. Generally we see data go end to end in a matter of minutes, but occasionally there are spikes in latency.
  • Robust data transfer mechanism?
    1 project | /r/learnpython | 24 Apr 2021
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 23 Apr 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Stats

Basic python-mysql-replication repo stats
5
2,254
9.2
23 days ago

The primary programming language of python-mysql-replication is Python.

Popular Comparisons

  1. python-mysql-replication VS AWS Data Wrangler
  2. python-mysql-replication VS PyMySQL
  3. python-mysql-replication VS PonyORM
  4. python-mysql-replication VS sparc-curation
  5. python-mysql-replication VS preshed
  6. python-mysql-replication VS mycli
  7. python-mysql-replication VS psycopg2cffi
  8. python-mysql-replication VS gevent
  9. python-mysql-replication VS legion
  10. python-mysql-replication VS Numba

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com