fluent VS kombu

Yes it works with MPP engines as the package is not used for orchestration purposes. It is meant to encourage a coding paradigm: functional programming. The benefit of the package is that it provides functions that make it easy to apply functional programming to data processing tasks. Similar projects with a different focus are: fluentpy and Pipe

It is feasible and there are a number of ways to do it. There are a few issues, though, mainly how to make sure that you are accessing the latest data and not getting part of the data mid write. A database handles these issues pretty well, since generally they are meant to be an intermediary between different processes. Another solution, that is often more flexible, is a message queue, like this one: https://github.com/celery/kombu

Above I use the library Kombu to create some connections and send some stuff. I started by setting up our environment variables. Then created exchange and queue objects. Finally, I made our connection object and the producer object, and then we sent a simple “Hello” message.