bbcrss VS Geo-IP-Database

I've been promoting this idea for a few years now, and I've seen an increasing number of people put it into action.

A fun way to track how people are using this is with the git-scraping topic on GitHub:

https://github.com/topics/git-scraping?o=desc&s=updated

That page orders repos tagged git-scraping by most-recently-updated, which shows which scrapers have run most recently.

As I write this, just in the last minute repos that updated include:

https://github.com/drzax/queensland-traffic-conditions

https://github.com/jasoncartwright/bbcrss

https://github.com/jackharrhy/metrobus-timetrack-history

https://github.com/outages/bchydro-outages

I have a couple of similar scrapers as well. One is a private repo that I collect visa information off Wikipedia (for Visalogy.com), and GeoIP information from MaxMind database (used with their permission).

https://github.com/Ayesh/Geo-IP-Database/

It downloads the repo, and dumps the data split by the first 8 bytes of the IP address, and saves to individual JSON files. For every new scraper run, it creates a new tag and pushes it as a package, so the dependents can simply update them with their dependency manager.