xidel
htmlq
xidel | htmlq | |
---|---|---|
18 | 27 | |
651 | 6,930 | |
- | - | |
5.6 | 2.3 | |
11 days ago | 7 months ago | |
Pascal | Rust | |
GNU General Public License v3.0 only | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
xidel
-
Move over jq I found something easier: fx
You could try Xidel[1]. It supports JSON, XML and HTML using XPath/XQuery 3.1
It has some extensions to the standard that are pretty nice (JSONiq, CSS selectors, html “template” matching), but you can limit it to just standard XPath/XQuery if you like.
I recommend getting the nightly v .99 build if you give it a try, the stable .98 version is pretty old and I’ve had no issues with .99
1. https://www.videlibri.de/xidel.html
-
Batch Win Installer - from a defined list of software, BWI will install software on 64 bit Windows 10/11 x64 machine without prompts ; check what software is installed and offer to install and/or upgrade software and scan program's websites to determine the latest version of the software available
Windows binary of Xidel (https://github.com/benibela/xidel) a commandline tool to download and extract data from HTML pages
- pup: Parsing HTML at the Command Line
- Remove white spaces from last column of CSV
-
What's the best tool to build pipelines from REST APIs?
Xidel for extraction and pagination
-
What are your coolest tools for one-liners ?
Download an entire subreddit to JSON Lines with Xidel:
-
Fetch data from XML
I believe that you can't read from a url with batch alone. you'll need a helper app like xidel https://www.videlibri.de/xidel.html
-
Tutorial: Rapid Script Development with Bash, JC, and JQ (no grep/sed/awk)
I have not played with this, but it looks like xidel might allow you to do this in Bash. jc also has a URL string parser that could be used in such a script.
- Xidel. A tool to query data from anything on the web and extract what you want
-
How to make http request with curl on certain page after being authenticated?
I built Xidel for such authenticated requests:
htmlq
- Htmlq: Like Jq, but for HTML
-
What monitoring tool do you use or recommend?
jq is pretty amazing. If you are comfortable with its jquery-like CSS selector syntax, then I should also mention a couple similar cli utilities that apply it to HTML: htmlp and pup.
- Yq is a portable yq: command-line YAML, JSON, XML, CSV and properties processor
- mgdm/htmlq: Like jq, but for HTML.
- hq: like jq, but for HTML
-
SQLite-HTML: A SQLite extension for querying, manipulating, and creating HTML
Hey, author here, happy to answer questions! A few other recent posts/tools that you may be interested in:
- sqlite-lines discussion from a few days ago: https://news.ycombinator.com/item?id=32288165
- htmlq, Rust CLI for (like jq but for html): https://github.com/mgdm/htmlq
- The Go library that sqlite-html uses for making runtime-loadable SQLite extensions https://github.com/riyaz-ali/sqlite
- sqlean, a ton of other helpful SQLite extensions (in C): https://github.com/nalgeon/sqlean
-
Any cool cURL/wget tools that you use?
thanks. that reminds me their's a jq for html: https://github.com/mgdm/htmlq
- A CLI to avoid remembering HTTP status codes
- A list of new(ish) command line tools – Julia Evans
- htmlq - like jq, but for HTML
What are some alternatives?
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
pup - Parsing HTML at the command line
tools - all-in collection of productivity scripts, CLI tools, utility libraries, fuse filesystems, and also some stuff
ht - Friendly and fast tool for sending HTTP requests
yq - Command-line YAML, XML, TOML processor - jq wrapper for YAML/XML/TOML documents
gron - Make JSON greppable!
hq - lightweight command line HTML processor using CSS and XPath selectors
xmltodict - Python module that makes working with XML feel like you are working with JSON
cascadia - Go cascadia package command line CSS selector