maintenance_tasks
A Rails engine for queueing and managing data migrations. (by Shopify)
Large Hadron Migrator
Online MySQL schema migrations (by soundcloud)
maintenance_tasks | Large Hadron Migrator | |
---|---|---|
2 | 3 | |
908 | 1,818 | |
1.0% | 0.3% | |
9.0 | 0.0 | |
4 days ago | 8 months ago | |
Ruby | Ruby | |
MIT License | BSD 3-clause "New" or "Revised" License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
maintenance_tasks
Posts with mentions or reviews of maintenance_tasks.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-02-17.
-
Dealing with race conditions in ruby scripts run concurrently
Check out https://github.com/Shopify/maintenance_tasks
-
Do you use migrations for data manipulations? What are the pro's and con's ?
We use this technique. https://github.com/Shopify/maintenance_tasks. It is similar to a job (it uses a job under the hood) that can be be paused, interrupted by a deploy, and even aborted.
Large Hadron Migrator
Posts with mentions or reviews of Large Hadron Migrator.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-12-03.
-
GitHub downtime root cause analysis
No you didn't. They're doing what is often referred as "online schema change" using https://github.com/github/gh-ost (but the concept is the same than percona's pt-online-schema-change, or https://github.com/soundcloud/lhm.
-
Database... or Goose?
Is there anything similar for MySQL? There is https://github.com/soundcloud/lhm but it's pretty much outdated nowadays
-
Do you use migrations for data manipulations? What are the pro's and con's ?
I may do it from the console or a task if I wanted to modify a large number of records, e.g. something in my Users table. I think you need a sense of how long the update will take - I'm not sure if there's any issue with migrations timing out or such like. If I modify my Users schema it takes 5 minutes or so as it has to make a copy of the table and swap it in and that works fine - https://github.com/soundcloud/lhm