gnu-parallel
up
gnu-parallel | up | |
---|---|---|
22 | 25 | |
25 | 8,150 | |
- | - | |
10.0 | 0.0 | |
about 9 years ago | 8 months ago | |
Perl | Go | |
GNU General Public License v3.0 only | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
gnu-parallel
-
SQL query execution idea
You can use GNU Parallel (https://www.gnu.org/software/parallel/) to run command-line clients with all of those queries. You can set up the upper limit of simultaneous clients run, and this will automatically handle all possible parallelism.
- Parallel – shell tool for executing jobs in parallel using one or more computers
-
Distcc: A fast, free distributed C/C++ compiler
Some other multi machine options that have worked well for me, well beyond just compilation of C/C++ on multiple machines with multiple cores.
1) set up passwordless, ssh.
and
2) use the gnu parallel. https://www.gnu.org/software/parallel/
gnu parallel is super flexible, very useful.
-
Peplum: F/OSS distributed parallel computing and supercomputing at Home with Ruby infrastructure
How does this stack up againg GNU parallel? If you just wanna parallelize CLI work-loads (like nmap), parallel should be easier, I guess.
-
Search in your Jupyter notebooks from the CLI, fast.
It requires jq for JSON processing and GNU parallel for concurrent searches in the notebooks.
- Is there a way to use all CPU cores while using RIBlast?
-
Can cuda help me here?
Since you've got lots of images, you could use GNU Parallel to spread the job across multiple CPUs.
-
5 great Perl scripts to keep in your sysadmin toolbox
Gnu parallel
- Is there an .deb package for installing GNU parallel?
-
Modern SPAs without bundlers, CDNs, or Node.js
You could easily use something like GNU Parallel:
https://www.gnu.org/software/parallel/
up
-
Fx – Terminal JSON Viewer
This fx rewrite is very exciting. I'll have to try it. I thought of fx as a wrapper around jq, that allowed quick iteration over building jq scripts. Sort of an Ultimate Plumber [1] but only for jq. It looks like it is now more like a JavaScript processor plus an interactive viewer.
Someone mention Visidata[2]? VisiData is also a TUI that is great on tabular data, and it can work with json. If your JSON is mostly tabular in nature, Visidata does a great job at showing that data and allowing you to explore it. A lot of json I deal with is tabular-like data. There is a great tutorial [3], that can help you get your bearings with Visidata. Once you understand those basics you might want to look at this thread [4] for what commands you can use with json.
[1] Ultimate Plumber: https://github.com/akavel/up
- Up: Plumber is a tool for writing Linux pipes with instant live preview
-
Show HN: LineSelect, shell utility to interactively select lines in a pipeline
Ultimate plumber can do this.
https://github.com/akavel/up
- Ultimate Plumber – a tool for writing Linux pipes with live preview
-
`jqp`, a TUI playground for `jq`
Been using up for years but this looks nice too
-
An interactive wrapper around `jq`
Fun. But I can achieve the same result (I think) with ultimate plumber and regular jq, but without being restricted just to jq. Feel free to correct me.
-
What are some useful cli tools that arent popular?
Up - The Ultimate Plumber makes the best pipes !
-
A list of new(ish) command line tools – Julia Evans
As an alternative allowing the use of any shell command/pipeline on the results interactively, see also: https://github.com/akavel/up
- RegExr: Learn, Build and Test Regex
-
Is there any command-line application that you wish existed but doesn't (or isn't as good as you wished)?
Would https://github.com/akavel/up solve your problem?
What are some alternatives?
Parallel
nvim-jqx - Populate the quickfix with json entries
bazel-buildfarm - Bazel remote caching and execution service
zsh-history-substring-search - 🐠 ZSH port of Fish history search (up arrow)
lolcate-rs - Lolcate -- A comically fast way of indexing and querying your filesystem. Replaces locate / mlocate / updatedb. Written in Rust.
dive - A tool for exploring each layer in a docker image
xidel - Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
fzf-tab - Replace zsh's default completion selection menu with fzf!
jc - CLI tool and python library that converts the output of popular command-line tools, file-types, and common strings to JSON, YAML, or Dictionaries. This allows piping of output to tools like jq and simplifying automation scripts.
fx - Terminal JSON viewer & processor
ripgrep - ripgrep recursively searches directories for a regex pattern while respecting your gitignore
hurl - Hurl, run and test HTTP requests with plain text.