symmetric-ds VS mydumper

For those interested in the source, here is the GitHub repo: https://github.com/JumpMind/symmetric-ds

There are several CDC (change data capture) solutions on the market. I've used https://www.symmetricds.org quite successfully in the past.

Use replication. https://www.symmetricds.org/

SymmetricDS is open source software for database replication, with support for one-way replication, multi-master replication, filtered synchronization, and transformations. Using web and database technologies, it can replicate data asynchronously as a scheduled or near real-time operation. Designed to scale to a large number of databases and operate between different platforms, it works across low-bandwidth connections and can withstand periods of network outage. SymmetricDS is multi-platform, has built in support for Spring extensions, supports transformations along a replication path, handles conflict resolution, is transaction aware, and embeddable in Android as well as other mobile platforms. The project is mostly written in Java, and you can check out our Github here.

You can create a MySQL backup for Railway.app using the MyDumper tool or by using a backup service like SimpleBackups. Both methods involve generating a dump file that can be used for restoration.

If you want reliable database backups you need an appropriate tool to actually make backups at the application level. So in the case of mysql/mariadb you would probably use mysqldump, mydumper or something like that. I mostly deal mariadb so I have an mydumper image, and a cronjob on the host that will start a container with a bind-mount to the host, and connected to the same network as the database server, then run mydumper and make a backup.

For SQL snapshots, I recommend mydumper. These are useful for partial restores and major version upgrades.

MySQLDump is too slow for that size- if you are going to logically export and import the db, use a parallel tool. The one I like is MyDumper, ( https://github.com/mydumper/mydumper ) but there are other alternatives. The compression and parallelism will get you a 5-20 speedup compared to the serial export and import. For small dbs and portable formats this is my preferred method.

We will talk about all this below. A very nice intro to the performance of the shell dumps / imports is also in this series of posts by Kenny Gryp. The benchmarks show that MySQL shell outperforms all other solutions (specifically mysqldump, mysqlpump and mydumper) in most situations.