bbcrss
Geo-IP-Database
bbcrss | Geo-IP-Database | |
---|---|---|
1 | 1 | |
5 | 8 | |
- | - | |
10.0 | 8.4 | |
5 months ago | 10 days ago | |
XSLT | ||
- | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bbcrss
-
Git scraping: track changes over time by scraping to a Git repository
I've been promoting this idea for a few years now, and I've seen an increasing number of people put it into action.
A fun way to track how people are using this is with the git-scraping topic on GitHub:
https://github.com/topics/git-scraping?o=desc&s=updated
That page orders repos tagged git-scraping by most-recently-updated, which shows which scrapers have run most recently.
As I write this, just in the last minute repos that updated include:
https://github.com/drzax/queensland-traffic-conditions
https://github.com/jasoncartwright/bbcrss
https://github.com/jackharrhy/metrobus-timetrack-history
https://github.com/outages/bchydro-outages
Geo-IP-Database
-
Git scraping: track changes over time by scraping to a Git repository
I have a couple of similar scrapers as well. One is a private repo that I collect visa information off Wikipedia (for Visalogy.com), and GeoIP information from MaxMind database (used with their permission).
https://github.com/Ayesh/Geo-IP-Database/
It downloads the repo, and dumps the data split by the first 8 bytes of the IP address, and saves to individual JSON files. For every new scraper run, it creates a new tag and pushes it as a package, so the dependents can simply update them with their dependency manager.
What are some alternatives?
gesetze-im-internet - Archive of German legal acts (weekly archive of gesetze-im-internet.de)
github-actions - Infromation and tips regarding GitHub Actions
shot-scraper - A command-line utility for taking automated screenshots of websites
metrobus-timetrack-history - Tracking Metrobus location data
bchydro-outages - Track BCHydro Outages via Git history
mastodon-scraping - Repository for scraping public information from Mastodon
scrape-san-mateo-fire-dispatch
torvenyek - Magyar törvények git repo
hun_law_rs - Tool for parsing hungarian laws (Rust version)
carbon-intensity-forecast-tracking - The reliability of the National Grid's Carbon Intensity forecast