pipes VS node-red

https://github.com/pipes-digital/pipes can extract feeds from pages. Pattern recognizer logic when trying the UI is a bit simple, but you can also write selectors on your own. It could work for you.

I'm not sure I understand the need, but take a look at https://pipes.digital/

Merging feeds is one of the main use cases of my site pipes. It might be one of the site you stumbled upon and dismissed, but there is an AGPL licensed version you can self-host at https://github.com/pipes-digital/pipes.

Great writeup, especially with all the workflow canvas screenshots. Makes me want to try out Node-RED.

From a few weeks ago on HN:

https://github.com/pipes-digital/pipes

“pipes.digital is a spiritual successor to Yahoo Pipes, a graphical interface to get data from the web and to manipulate it by connecting block”

These look like great tools.

I think calling these low-code / no-code frameworks is however quite misleading though, because there is actually code, it’s just inside the component! Code still has to be written.

One thing that these low-code / no-code frameworks do well is provide a structure that you can easily show visually.

This is particularity useful when you have to work with clients that aren’t that technical. It makes creating specifications much easier, which can be reviewed and revised before embarking on a big development effort.

Thanks! Piku has been my go-to for dev environments, Linux IoT and general-purpose stuff for a long while now, as it is simpler to iterate (no container build cycles, no need for a registry, relies on rock solid nginx/uwsgi, etc.).

I usually start with that and then containerize as needed, but this time it was actually the other way around -- since I didn't know what Node-RED modules I'd need and didn't see much point in going beyond a single core, I just sidestepped my custom Node-RED containers* and pushed out a Node-RED deployment to a underused, single-core piku instance.

(FWIW, I have a running k3s setup with the Azure equivalent of spot instances, but Node-RED can't take advantage of that setup and I mostly wanted the GUI and higher-level abstractions. You'd be surprised how much mileage you can get from something like this...)

* - https://github.com/insightfulsystems/node-red