gh-ost
hub
Our great sponsors
gh-ost | hub | |
---|---|---|
32 | 23 | |
11,934 | 22,667 | |
1.0% | 0.1% | |
7.4 | 4.2 | |
4 days ago | about 2 months ago | |
Go | Go | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
gh-ost
-
How Modern SQL Databases Are Changing Web Development - #3 Better Developer Experience
I’ve been through multiple incidents where everything worked fine in the testing environment but ended up locking the production database for minutes when deployed. A category of open-source tools called OSC (Online Schema Change) exists to mitigate such pain, like gh-ost used by GitHub and OSC used by Meta. They work by creating a set of "ghost tables" to apply the migrations, copy over old data from the original tables, and catch up with new writes simultaneously. When all old data is migrated, you can trigger a cutover to make the "ghost tables" production. Check the post below for a great introduction and comparison:
-
We migrated to SQL. Our biggest learning? Don't use Prisma
Sounds like it's basically explained in the gh-ost readme https://github.com/github/gh-ost#how
I think it amounts to "use views to decouple access to the table with a fixed interface" and "use triggers for migrating data between tables"
-
Ask HN: Is PostgreSQL better than MySQL?
Gh-ost is the new hotness. Simple to use and lots of great features: https://github.com/github/gh-ost
-
Changing column from longtext to mediumtext taking over 2 hours
As they have said it depends on the size of the table on disk and the number of rows, but an alter in production is not difficult to last from seconds to days. I don't know if you are doing the alter as is but try to check https://docs.percona.com/percona-toolkit/pt-online-schema-change.html or https://github.com/github/gh-ost , they usually simplify a lot the alters.
Not sure which version of MySQL you're using, but one approach would be to use a tool like pt-online-schema-change (from Percona) or g-host -- which will create a duplicate table and then swap it in place of the original table. It's a safer approach when operating in production environments. Here's a good comparison of the tools many people use https://planetscale.com/docs/learn/online-schema-change-tools-comparison
-
Changing Tires at 100mph: A Guide to Zero Downtime Migrations
Actually I never tried but I was scared by the small print of GH not using RDS themselves [1] and Ghost relying on lower-level features that might be not easily available in RDS. Also I had the impression you have to setup a normal non-RDS replica attached to your RDS master?
MySQL has some robust tooling in this space. Some of the tools use triggers to copy to a new table. GitHub's gh-ost[1] is probably the state of the art, and uses the binary log stream to replicate the data.
-
How Retool upgraded its 4 TB main application PostgreSQL database
https://github.com/github/gh-ost/issues/331#issuecomment-266...) it does become a little bit of a "you do not have google problems" type discussion.
(Perhaps you do have such problems, I don't know where you work! But 99%+ of companies don't have such problems and never will.)
-
We lost 54k GitHub stars
GitHub doesn't use foreign keys[1], and there's likely many tables related to all the users, notifications, permissions, etc... that would need to be cleaned up. Without foreign keys they likely have some system process that does this instead of a simple `DELETE FROM` which cascades.
1. https://github.com/github/gh-ost/issues/331#issuecomment-266...
hub
-
Pull request Best Practices
Try automating the PR process as much as possible. Make use of tools like hub CLI for speeding up the pull request process. Code quality tools can help you automate the due diligence for coding standards and conventions, and test automation tools can assist in bug discovery, and identifying security vulnerabilities.
- Problem with Docker Hub and submodules
-
[Media] I made a Rust CLI game that tests how fast you can guess the language of a code block!
parse_git_branch() { # Speed up opening up a new terminal tab by not # checking `$HOME` ...which can't be a repo anyway # # For the heck of it, micro-optimize this too: # time (repeat 1000000 { [ "$PWD" = "$HOME" ] } ) == ~4.2s # time (repeat 1000000 { [[ "$PWD" == "$HOME" ]] } ) == ~1.4s [[ "$PWD" == "$HOME" ]] && return # Fastest known way to check the current branch name # (Uses `command` to bypass wrappers like https://hub.github.com/) ref="$(command git symbolic-ref --short HEAD 2> /dev/null)" || return echo " [$ref]" }
- Mais de 10 coisas para fazer antes de solicitar revisão do seu Pull Request
-
Gitea – a painless self-hosted Git service
Which will create a new remote with that name (otherwise origin will be used).
It is also less typing.
-
My Termial Aliases
I alias git to use HUB from GitHub
-
Noob question: Up until now I've always started with creating a repository on github and cloning it to my pc. This time I've already started a project with vs code and am not sure how to get it to github. Do I just use 'Import a Repository' on github?
If you also install Hub https://github.com/github/hub it gives you a git create command, it also has a set of really useful additional CLI utilities.
-
My current Indie Hacking toolkit
SCM: Git + Hub (https://github.com/github/hub)
-
Get lazy with lazygit
This is my favorite feature of this tool. Because every time I commit something and want to create PR/MR, I have to do a bunch of repetitive clicks here and there. On top of that, sometimes I have to work with GitHub, sometimes GitLab. So even if I wanna use the GitHub CLI tool hub or GitLab CLI tool glab, I am ending up using two different tools. So it's nice when I can open PR/MR just by a shortcut within a second or two regardless of what SCM I am on.
-
Apps, Tools, and Gear I Use (2021 edition)
Hub - a wrapper for Git command (Git+Hub=GitHub).
What are some alternatives?
gron - gron, Cron Jobs in Go.
resty - Simple HTTP and REST client library for Go
ngrok - Introspected tunnels to localhost
goreporter - A Golang tool that does static analysis, unit testing, code review and generate code quality report.
pg-online-schema-change - Easy CLI tool for making zero downtime schema changes and backfills in PostgreSQL [Moved to: https://github.com/shayonj/pg-osc]
doctrine-test-bundle - Symfony bundle to isolate your app's doctrine database tests and improve the test performance
hystrix-go - Netflix's Hystrix latency and fault tolerance library, for Go
GJSON - Get JSON values quickly - JSON parser for Go
goreleaser - Deliver Go binaries as fast and easily as possible
ctop - Top-like interface for container metrics
xlsx - Go library for reading and writing XLSX files.
circuitbreaker - Circuit Breakers in Go