fetchurls
bpkg
fetchurls | bpkg | |
---|---|---|
4 | 4 | |
123 | 1,873 | |
- | 0.4% | |
0.0 | 4.4 | |
over 2 years ago | 5 months ago | |
Shell | Shell | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fetchurls
-
Best way to back up entire website on a schedule
You could also look into something like archivebox.io, but it doesn't really mirror so great. fetchurls can make an URL list though which could in turn be fed into archivebox. Archivebox would maybe be handy if you wanted the wget download along with a PDF print + maybe sending to Wayback Machine.
-
How do I get a list of all the individual track links of a bandcamp album/user?
fetchurls tries to grab them. Can put the domain as artist.bandcamp.com
-
Options to backup https://trythatsoap.com/?
Welcome. Since Archivebox doesn't crawl pages, you might be interested in something like fetchurls as well.
- is there a way to take "snapshots" of every page of a website?
bpkg
What are some alternatives?
ArchiveBox - 🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
basher - A package manager for shell scripts.
Yacy - Distributed Peer-to-Peer Web Search Engine and Intranet Search Appliance
hackintosh-full-installer - Repo for a script that can complete part of the task of creating a full Hackintosh installer entirely from Linux.
browsertrix-crawler - Run a high-fidelity browser-based crawler in a single Docker container
vscode-code-runner - Code Runner for Visual Studio Code
kusionstack.io - Source for kusionstack.io site
YT-DLP-SCRIPTS - ...Just a place for me to share my various YT-DLP & related bash scripts.
bach - Bach Testing Framework
nvm - Node Version Manager - POSIX-compliant bash script to manage multiple active node.js versions
autogpt4all - 🛠️ User-friendly bash script for setting up and configuring your LocalAI server with the GPT4All for free! 💸
coderun - ⏯️ Code runner CLI that can run any languages