Our great sponsors
-
ohmyzsh
🙃 A delightful community-driven (with 2,300+ contributors) framework for managing your zsh configuration. Includes 300+ optional plugins (rails, git, macOS, hub, docker, homebrew, node, php, python, etc), 140+ themes to spice up your morning, and an auto-update tool so that makes it easy to keep up with the latest updates from the community.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
oh-my-bash
A delightful community-driven framework for managing your bash configuration, and an auto-update tool so that makes it easy to keep up with the latest updates from the community.
Look into https://ohmyz.sh/ or https://github.com/zdharma-continuum/zinit (or any other plugin managers) and some nice plugins.
+1 on oh-my-zsh
I recommend Oh My Zsh with the zsh-autosuggestions and zsh-syntax-highlighting plugins.
https://github.com/zsh-users/zsh-autosuggestions
https://github.com/zsh-users/zsh-syntax-highlighting
And my custom theme ;) https://github.com/whyboris/dotfiles/blob/main/yboris.zsh-th...
+1 on oh-my-zsh
I recommend Oh My Zsh with the zsh-autosuggestions and zsh-syntax-highlighting plugins.
https://github.com/zsh-users/zsh-autosuggestions
https://github.com/zsh-users/zsh-syntax-highlighting
And my custom theme ;) https://github.com/whyboris/dotfiles/blob/main/yboris.zsh-th...
I switched from Bash to ZSH with the caveat that I use prezto and powerlevel10k (included with prezto) and I will never go back.
Look into https://ohmyz.sh/ or https://github.com/zdharma-continuum/zinit (or any other plugin managers) and some nice plugins.
+1 on oh-my-zsh
I recommend Oh My Zsh with the zsh-autosuggestions and zsh-syntax-highlighting plugins.
https://github.com/zsh-users/zsh-autosuggestions
https://github.com/zsh-users/zsh-syntax-highlighting
And my custom theme ;) https://github.com/whyboris/dotfiles/blob/main/yboris.zsh-th...
I really wonder how much of the zsh "love" comes from two things:
1. it being the new Mac default
2. oh-my-zsh
And if the second is important, I wonder how many people have never tried anything similar for bash, such as https://github.com/ohmybash/oh-my-bash (never used it myself, but it has stars!)
This description, to me, sounds like you wrote a Python program... in shell. Nothing wrong with Python programs, but writing them in shell is about as pleasant as writing them in C.
The shell’s parallel processing capabilities shine when you want consecutive stream transformation steps to run in parallel (note that you can pipe to and from loops, over multiple descriptors if necessary). When your task can be structured like that, it will often take as much time to write a parallel implementation in shell as a serial one in Python (etc.). On the other hand, running multiple iterations of the same step in parallel is, as you’ve seen, awkward.
If the only thing you actually need to parallelize is HTTP requests, you might find piping things into aria2c[1] or the like to generate temporary files with responses and then processing those serially (best if your tool can tell you on stdout when a job is done, otherwise inotifywait and its ilk[2] may help if you’re uncomfortable just hammering the filesystem). When that is not enough, you could try GNU Parallel[3] or, if all else fails, implementing a jobserver in the style of GNU Make[4], which you may find more pleasant to do in shell than your current design.
But at that point (in particular if you’re not I/O-bound) it might be best to just not do it in shell[5].
[1] https://aria2.github.io/manual/en/html/aria2c.html
[2] https://jvns.ca/blog/2020/06/28/entr/
[3] https://www.gnu.org/software/parallel/
[4] https://www.gnu.org/software/make/manual/html_node/POSIX-Job...
[5] https://sanctum.geek.nz/etc/emperor-sh-and-the-traveller.txt