jenkins-std-lib VS notes

> On a previous team I had used Concourse CI to some extent, but I wasn’t really blown away by the experience. Travis and Circle were mentioned. I was a fool. I should have committed to seriously researching some of the contenders and making a more informed decision, but I lacked the willpower and the discernment.

The whole post can be summed up as he had very little CICD experience. Made lots of beginner mistakes, which is easy to do in Jenkins. Then decided to write a post where all his complaints about Jenkins are not only wrong but are the issues that plague all the other CICD tools.

> So instead of writing Bash directly, you’re writing Bash inside Groovy

Why are you doing that? You have a fully featured programming language and you are running `sh('npm install')`. You could do this instead https://github.com/DontShaveTheYak/jenkins-std-lib/blob/mast... . How is bash inside of YAML better?

> The trouble is: Groovy is a much, much worse language for executing commands than Bash. Bash is interpreted, has a REPL that is great for experimentation, does require a ton of imports, and has lightweight syntax. Groovy has none of these things.

Groovy has a language server, linters and a vscode IDE plugins. They are probably not as stable or full featured as the bash ones, but they are available and very few take advantage of them. Again, how is YAML+Bash better?

> The way that developers test their Groovy steps is by triggering a job on the remote Jenkins server to run them. The feedback loop is 2 orders of magnitude slower than it is for just executing Bash locally.

This is a rookie mistake. For about 60-75% of pipelines you can run them locally in a docker container on your local machine. You can even set up hot code reload so as you change your pipeline the Jenkins reloads it. You can also configure the job to kick off a build when it reloads the code. When Jenkins is configured correctly it has the fastest feedback loop of any CICD tool on the market. GitHub actions comes in a close second since it can also be run locally but you cant run a "clone" of what you run in production, like having the same secrets, so it gets second place. Beside Jenkins and GitHub actions, I dont know of any solutions for the other tools.

You can run a GitHub action on Jenkins. It's a very deep and complex system. It's like an iceberg and so many engineers dont leave the surface before deciding it sucks and one of the YAML CICD tools is better. Sure the YAML alternatives are EASY to get started with and to do basic stuff with. But they are Terrible at anything complex. While Jenkins is not easy to get started with, once mastered, you can build complex pipelines with ease.

I get that I'm a Jenkins fanboy. Most of the things I mentioned above, I either contribute to or I'm the author of. I know Jenkins has issues. I know it has hurt lots of people, I read the complaints online. But it's still the best out there. The best software in the world is not written in bash or yaml and the same is true of the best CICD pipelines in the world. It's a shame very few people get to see/use those pipelines.

With Jenkins you can still run your favorite GitHub actions. https://github.com/DontShaveTheYak/jenkins-std-lib/blob/master/jobs/github/actions/step_example.groovy

This library has a lot of helpful features https://github.com/DontShaveTheYak/jenkins-std-lib , one of my favorites is being able to run GitHub actions natively in Jenkins pipelines.

Here is an example using s6 overlay https://github.com/DontShaveTheYak/jenkins-std-lib/tree/master/docker/prod

Run a Jenkins locally in docker. I use a vscode dev container for this. https://github.com/DontShaveTheYak/jenkins-std-lib/blob/master/.devcontainer/devcontainer.json

I do my best https://github.com/DontShaveTheYak/jenkins-std-lib

If you use Jenkins and want to try actions then check out https://github.com/DontShaveTheYak/jenkins-std-lib

It let's you run actions on top of Jenkins.

I've been doing something similar for ~20 years at: https://github.com/nickjj/notes

    - Running `notes` will open this month's notes for YYYY_MM.txt

I use a very command line focused approach with https://github.com/nickjj/notes.

Since about 2001 I used YYYY-MM.txt plain text files and have a shell script to help create notes in the most friendly way I could think of from the command line at https://github.com/nickjj/notes.

Totally works fine for a knowledge log when you're streaming high level details. I still use it today.

But when you want to really go all-in with in-depth notes it's tricky because in 1 month's time if you're hardcore deep in the woods of learning, applying and using something you're going to end up with hundreds of concepts from an assorted set of tools and it kind of stinks to have all of that info sitting in 1 file. Think about using something like Kubernetes. That's really Kubernetes, Kustomize / Helm, EKS, various cloud hosting details (networking, etc.), Terraform and ton of super useful commands / context. Details you for sure want recorded for later.

For this type of info I've been building up a knowledge base with https://obsidian.md/. It's really nice and I highly recommend it. It's been working well for keeping things reasonably categorized without wasting a lot of time on the details around keeping links and tags up to date. It also has Vim mode that's good enough where day to day writing feels natural.

Did you end up automating the entries?

For example, I have a command line note taking script at https://github.com/nickjj/notes.

It creates a YYYY-MM-DD.txt file and doesn't include time stamps but it would be a 1 line change to make each entry get timestamped. I didn't do that because personally I'm more interested in monthly notes not per minute.

But I do think removing the barrier of creating entries is an important step with jotting things down, this way you can focus on what you want to write and not the boilerplate.

A whole bunch of little things, mainly command line tools.

Most of them are open source and also have extensive documentation and a screencast video going over them.

In no specific order:

- https://github.com/nickjj/notes

- https://github.com/nickjj/invoice

- https://github.com/nickjj/wait-until

And a few recent little scripts to solve specific things:

- https://nickjanetakis.com/blog/using-ffmpeg-to-get-an-mp3s-d...

- https://nickjanetakis.com/blog/a-shell-script-to-keep-a-bunc...

- https://nickjanetakis.com/blog/bash-aliases-to-prepare-recor...

Along similar lines, nickjj also has a similar (but bash) notes script at:

https://github.com/nickjj/notes

While I don't use it personally there's: https://obsidian.md/

It's cross platform and works offline. You write markdown and it produces a visual graph of your data. It supports interlinking notes, tags and images too.

Plain text notes[0] work best for me but I'd probably use Obsidian if I wanted to see things visually. When I tried it out briefly it was really solid.

[0]: https://github.com/nickjj/notes