pillager
fetchurls
pillager | fetchurls | |
---|---|---|
1 | 4 | |
114 | 123 | |
- | - | |
0.0 | 0.0 | |
almost 3 years ago | over 2 years ago | |
Shell | Shell | |
The Unlicense | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pillager
fetchurls
-
Best way to back up entire website on a schedule
You could also look into something like archivebox.io, but it doesn't really mirror so great. fetchurls can make an URL list though which could in turn be fed into archivebox. Archivebox would maybe be handy if you wanted the wget download along with a PDF print + maybe sending to Wayback Machine.
-
How do I get a list of all the individual track links of a bandcamp album/user?
fetchurls tries to grab them. Can put the domain as artist.bandcamp.com
-
Options to backup https://trythatsoap.com/?
Welcome. Since Archivebox doesn't crawl pages, you might be interested in something like fetchurls as well.
- is there a way to take "snapshots" of every page of a website?
What are some alternatives?
PADD - PADD (formerly Chronometer2) is a more expansive version of the original chronometer.sh that is included with Pi-Hole. PADD provides in-depth information about your Pi-hole.
ArchiveBox - 🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
google-group-crawler - [Deprecated] Get (almost) original messages from google group archives. Your data is yours.
Yacy - Distributed Peer-to-Peer Web Search Engine and Intranet Search Appliance
bpkg - Lightweight bash package manager
browsertrix-crawler - Run a high-fidelity browser-based crawler in a single Docker container
kusionstack.io - Source for kusionstack.io site
bach - Bach Testing Framework