Our great sponsors
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wget2
-
A few tips for the newcomers on this sub !
Concurrent downloadsAble to preserve the original treeClient/Server modeCLITUIGUIWeb UIBrowser pluginwgetNYNY??Y?wget2YYNY????aria2YNYYY?Y?rcloneYYNY??Y?IDMYNNNNYNNJDownloader2YNYNNYNN
- The curl-wget Venn diagram
- GNU Wget2 now has semi-experimental DANE support!
- libwget forms the core of wget2, an HTTP(S) file downloader and website mirror utility, written entirely in C, and stuffed full of modern features.
-
Which is more common out of the box, curl or wget?
A libwget is one of the goals of wget2.
-
Command-line Tools can be 235x Faster than your Hadoop Cluster
Another tip is using wget2 instead of wget if you're mirroring a site (but this is more I/O tip than computationally heavy) https://gitlab.com/gnuwget/wget2/-/wikis/home
Sadly, wget2 doesn't support WARC last time I checked, but wget2 comes with a `--max-threads` parameter that together with `--mirror` and `--tries` makes it trivial to mirror even the slowest websites out there.
-
wget2 is a dead project or isn’t it?
Yup, there are some other contributors of course, but by and large, it's just Tim aka rockdaboot: https://gitlab.com/gnuwget/wget2/-/commits/master
-
I need to download 50 files in parallel chunks using wget.
wget 2.0 alpha supports multiple parallel downloads, if you don't mind installing another program for what I assume is a one-off task.
-
Is there a command "wget2" ?
There's a link to https://gitlab.com/gnuwget/wget2 on the wget homepage.
-
Where to extract and install system type files?
My package manager, Synaptic, does not have wget2 so I am getting it from gitlab:' https://gitlab.com/gnuwget/wget2/-/blob/master/README.md
ht
-
Curl is now a CVE Numbering Authority
No need to use curl, make HTTP requests great again with https://github.com/ducaale/xh
-
Why people in Google hate Go?
Except when you actually enjoy things being fast. For example, HTTPie easily adds 0.5-1s delay to every request because it's written in Python, especially on the first invocation. xh (https://github.com/ducaale/xh), on the other hand, starts immediately because it's written in Rust. I very much like this trend.
-
HTTPie Desktop: cross-platform API testing client for humans
HTTPie is great and was a big improvement for me over cURL.
However, I ended up switching to xh[1] as it's significantly faster and I prefer its output.
https://github.com/ducaale/xh
-
Tell HN: Postman just wiped all my stuff
No, but unless portability is a concern or you're massively familiar with curl, you might want to consider xh. It's much more intuitive.
https://github.com/ducaale/xh
-
🐚🦀Comandos shell reescritos em Rust
xh
- Insomnia REST client now requires an account
-
The curl-wget Venn diagram
wget on the other hand, automatically converts the ñ to UTF-8 hex and resolves the link perfectly.
I've searched the curl manpage and couldn't find a way to solve this. Please help.
I'm having to use `xh --curl` [1] to "fix" the links before I pass them to curl.
[1] https://github.com/ducaale/xh
-
Get better with Vim one tip at a time
Very nice, you should add xh to the User-Agents though.
-
I Could Rewrite Curl
While not a rewrite - one recent tool for making http requests which i quite enjoy is:
https://github.com/ducaale/xh
It's basically python httpie rewritten in rust. my only gripe is that i keep forgetting that it exists - and that "xh" is for http and "xhs" is for https.
So i frequently end up with curl anyway:)
- xh: Friendly and fast tool for sending HTTP requests (HTTPie in Rust)
What are some alternatives?
axel - Lightweight CLI download accelerator
rustdesk - An open-source remote desktop, and alternative to TeamViewer.
aria2 - aria2 is a lightweight multi-protocol & multi-source, cross platform download utility operated in command-line. It supports HTTP/HTTPS, FTP, SFTP, BitTorrent and Metalink.
htmlq - Like jq, but for HTML.
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
httpie - 🥧 HTTPie CLI — modern, user-friendly command-line HTTP client for the API era. JSON support, colors, sessions, downloads, plugins & more.
fd - A simple, fast and user-friendly alternative to 'find'
gitoxide - An idiomatic, lean, fast & safe pure Rust implementation of Git
wgetmicro
tty-share - Share your linux or osx terminal over the Internet.
Firefox-automatic-install-for-Linux - Read-only mirror of https://gitlab.com/Linux-Is-Best/Firefox-automatic-install-for-Linux
thgtoa - The Hitchhiker’s Guide to Online Anonymity