Large Hadron Migrator
BatchLoader
Our great sponsors
| Large Hadron Migrator | BatchLoader | |
|---|---|---|
| 3 | 1 | |
| 1,759 | 927 | |
| 0.5% | - | |
| 0.0 | 0.0 | |
| over 2 years ago | 15 days ago | |
| Ruby | Ruby | |
| BSD 3-clause "New" or "Revised" License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Large Hadron Migrator
-
GitHub downtime root cause analysis
No you didn't. They're doing what is often referred as "online schema change" using https://github.com/github/gh-ost (but the concept is the same than percona's pt-online-schema-change, or https://github.com/soundcloud/lhm.
-
Database... or Goose?
Is there anything similar for MySQL? There is https://github.com/soundcloud/lhm but it's pretty much outdated nowadays
-
Do you use migrations for data manipulations? What are the pro's and con's ?
I may do it from the console or a task if I wanted to modify a large number of records, e.g. something in my Users table. I think you need a sense of how long the update will take - I'm not sure if there's any issue with migrations timing out or such like. If I modify my Users schema it takes 5 minutes or so as it has to make a copy of the table and swap it in and that works fine - https://github.com/soundcloud/lhm
BatchLoader
-
N+1 problem will never be an issue with N1Loader gem
Interesting, I've just been researching Dataloader implementations for Ruby and have between trying to decide between GraphQL::Dataloader, graphql-batch and BatchLoader. I'll give this a look as well. Can you also make API calls inside the loaders?
What are some alternatives?
SecondBase - Seamless second database integration for Rails.
Rails DB - Rails Database Viewer and SQL Query Runner
Redis Dashboard - Sinatra app to monitor Redis servers.
Squasher - Squasher - squash your old migrations in a single command
Lol DBA - lol_dba is a small package of rake tasks that scan your application models and displays a list of columns that probably should be indexed. Also, it can generate .sql migration scripts.
Blazer - Business intelligence made simple
Foreigner - Adds foreign key helpers to migrations and correctly dumps foreign keys to schema.rb
ActiveRecord::DataIntegrity - Check data integrity for your ActiveRecord models
Scenic - Versioned database views for Rails
Database Cleaner - Strategies for cleaning databases in Ruby. Can be used to ensure a clean state for testing.
graphql-batch - A query batching executor for the graphql gem
DatabaseValidations - Database validations for ActiveRecord