bbcrss
Geo-IP-Database

bbcrss | Geo-IP-Database | |
---|---|---|
1 | 1 | |
5 | 8 | |
- | - | |
10.0 | 8.2 | |
about 1 year ago | 3 days ago | |
XSLT | ||
- | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bbcrss
-
Git scraping: track changes over time by scraping to a Git repository
I've been promoting this idea for a few years now, and I've seen an increasing number of people put it into action.
A fun way to track how people are using this is with the git-scraping topic on GitHub:
https://github.com/topics/git-scraping?o=desc&s=updated
That page orders repos tagged git-scraping by most-recently-updated, which shows which scrapers have run most recently.
As I write this, just in the last minute repos that updated include:
https://github.com/drzax/queensland-traffic-conditions
https://github.com/jasoncartwright/bbcrss
https://github.com/jackharrhy/metrobus-timetrack-history
https://github.com/outages/bchydro-outages
Geo-IP-Database
-
Git scraping: track changes over time by scraping to a Git repository
I have a couple of similar scrapers as well. One is a private repo that I collect visa information off Wikipedia (for Visalogy.com), and GeoIP information from MaxMind database (used with their permission).
https://github.com/Ayesh/Geo-IP-Database/
It downloads the repo, and dumps the data split by the first 8 bytes of the IP address, and saves to individual JSON files. For every new scraper run, it creates a new tag and pushes it as a package, so the dependents can simply update them with their dependency manager.
What are some alternatives?
gesetze-im-internet - Archive of German legal acts (weekly archive of gesetze-im-internet.de)
scrape-san-mateo-fire-dispatch
shot-scraper - A command-line utility for taking automated screenshots of websites
carbon-intensity-forecast-tracking - The reliability of the National Grid's Carbon Intensity forecast
hun_law_rs - Tool for parsing hungarian laws (Rust version)
mastodon-scraping - Repository for scraping public information from Mastodon
metrobus-timetrack-history - Tracking Metrobus location data
queensland-traffic-conditions - A scraper that tracks changes to the published queensland traffic incidents data
gh-action-data-scraping - this shows how to use github actions to do periodic data scraping
github-actions - Infromation and tips regarding GitHub Actions
