aws_lambda_reddit_api
xidel
| aws_lambda_reddit_api | xidel | |
|---|---|---|
| 2 | 18 | |
| 0 | 653 | |
| - | - | |
| 4.2 | 5.6 | |
| about 2 years ago | 23 days ago | |
| Python | Pascal | |
| - | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aws_lambda_reddit_api
-
What's the best tool to build pipelines from REST APIs?
I have a small project like this i done before. Which i am gonna shamelessly plug in lol. https://github.com/PanzerFlow/aws_lambda_reddit_api
- Is it worth me applying to Data Engineering roles with this Resume/CV?
xidel
-
Move over jq I found something easier: fx
You could try Xidel[1]. It supports JSON, XML and HTML using XPath/XQuery 3.1
It has some extensions to the standard that are pretty nice (JSONiq, CSS selectors, html “template” matching), but you can limit it to just standard XPath/XQuery if you like.
I recommend getting the nightly v .99 build if you give it a try, the stable .98 version is pretty old and I’ve had no issues with .99
1. https://www.videlibri.de/xidel.html
-
Batch Win Installer - from a defined list of software, BWI will install software on 64 bit Windows 10/11 x64 machine without prompts ; check what software is installed and offer to install and/or upgrade software and scan program's websites to determine the latest version of the software available
Windows binary of Xidel (https://github.com/benibela/xidel) a commandline tool to download and extract data from HTML pages
- pup: Parsing HTML at the Command Line
- Remove white spaces from last column of CSV
-
What's the best tool to build pipelines from REST APIs?
Xidel for extraction and pagination
-
What are your coolest tools for one-liners ?
Download an entire subreddit to JSON Lines with Xidel:
-
Fetch data from XML
I believe that you can't read from a url with batch alone. you'll need a helper app like xidel https://www.videlibri.de/xidel.html
-
Tutorial: Rapid Script Development with Bash, JC, and JQ (no grep/sed/awk)
I have not played with this, but it looks like xidel might allow you to do this in Bash. jc also has a URL string parser that could be used in such a script.
- Xidel. A tool to query data from anything on the web and extract what you want
-
How to make http request with curl on certain page after being authenticated?
I built Xidel for such authenticated requests:
What are some alternatives?
astro-sdk - Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
memphis - Memphis.dev is a highly scalable and effortless data streaming platform
tools - all-in collection of productivity scripts, CLI tools, utility libraries, fuse filesystems, and also some stuff
gnu-parallel - A clone of GNU Parallel (git://git.savannah.gnu.org/parallel.git)
pup - Parsing HTML at the command line
gron - Make JSON greppable!
yq - Command-line YAML, XML, TOML processor - jq wrapper for YAML/XML/TOML documents
xmltodict - Python module that makes working with XML feel like you are working with JSON
xmlq - filter xml in the command line with xpath
blog.rust-lang.org - Home of the Rust and Inside Rust blogs
JsonPath - Java JsonPath implementation