wi-page
jq
| wi-page | jq | |
|---|---|---|
| 2 | 306 | |
| 1 | 25,063 | |
| - | - | |
| 0.0 | 0.0 | |
| about 3 years ago | 11 months ago | |
| Python | C | |
| - | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wi-page
-
Ask HN: What are the best tools for web scraping in 2022?
[4] https://github.com/altilunium/wi-page (Scrap wikipedia to get most active contributors that contribute to a certain article)
- Show HN: Wi-Page – Rank Wikipedia Article's Contributors by Byte Counts
jq
-
GNU Parallel, where have you been all my life?
That should recursively list directories, counting only the files within each, and output² jsonl that can be further mangled within the shell². You could just as easily populate an associative array for further work, or $whatever. Unlike bash, zsh has reasonable behaviour around quoting and whitespace too.
¹ https://zsh.sourceforge.io/Doc/Release/User-Contributions.ht...
² https://github.com/jpmens/jo
³ https://github.com/stedolan/jq
- How do i edit reputation?
-
Jj: JSON Stream Editor
What I miss from jq and what is implemented but unreleased is platform independent line delimiters.
jq on Windows produces \r\n terminated lines which can be annoying when used with Cygwin / MSYS2 / WSL. The '--binary' option to not convert line delimiters is one of those pending improvements.
https://github.com/stedolan/jq/commit/0dab2b18d73e561f511801...
-
Building and deploying a web API powered by ChatGPT
If you have jq installed you can use it to make the output look nicer.
-
Search in your Jupyter notebooks from the CLI, fast.
It requires jq for JSON processing and GNU parallel for concurrent searches in the notebooks.
- Check the jq manual!
- mkv vs mp4 metadata
-
Amazon Begs Employees Not to Leak Corporate Secrets to ChatGPT
jq is your friend.
- Memes are all cool and all. But this is your daily remaining that 10000! =
-
How to export/import/externally-edit/whatever WI entries?
The jq command (https://stedolan.github.io/jq/) is useful pulling that information out.
What are some alternatives?
kiwix-hotspot - Kiwix Hotspot Image Creator (Desktop) for Windows/macOS/Linux
yq - Command-line YAML, XML, TOML processor - jq wrapper for YAML/XML/TOML documents
estela - estela, an elastic web scraping cluster 🕸
dasel - Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.
danker - Compute PageRank on >3 billion Wikipedia links on off-the-shelf hardware.
gojq - Pure Go implementation of jq
scrapy-redis - Redis-based components for Scrapy.
json5 - JSON5 — JSON for Humans
polite - Be nice on the web
jp - Validate and transform JSON with Bash
curl-impersonate - curl-impersonate: A special build of curl that can impersonate Chrome & Firefox
nushell - A new type of shell