FlaUI VS AutoKey

If you are looking to automate this all through the GUI of each app involved then I suggest using FlaUI or some other wrapper around UIA

FlaUI

The best open-source library for writing UIA for native Windows desktop apps is FlaUI if you find the problem space interesting. I started learning about all types of UIA when I started at a company doing QA work. Now I worked on UIA because I learned from my experience how bad UIA support is in most applications, and I am disappointed that people who are disabled have that to look forward to, not to mention that if my hands were ever crushed or some other maiming were to occur, I would be depending on UIA as well. Since that realization, I have tried to get more developers interested in UI automation and its quality, not just because of its effect on others with disabilities but because it benefits anyone in our profession to have that safety.

Alternatively if you're into dotnet, FlaUI is amazing for automation and gives you a sane environment. I moved to it when I couldn't deal with AutoIT scripts anymore and it's everything I needed. https://github.com/FlaUI/FlaUI

I would suggest taking a look at FlaUI https://github.com/FlaUI/FlaUI

What comes to mind is something like this one: https://github.com/FlaUI/FlaUI I don't think it can do the "search image on screen" part. A smooth mouse movement is only a series of mouse teleports, so that should be coded relatively easy. If you really don't know where the image is on screen and it also does not have a id to search for then it will be a little harder I guess. Like making a screenshot and putting it into some image processing library? Probably there are easier solutions out there

Is it possible to control another program via code? This link says yes and the following is the successor of what they originally recommended: https://github.com/FlaUI/FlaUI.

If you're like me and have way too many tabs open and then get lost whenever you need to access that one tab quickly again, then this software might help you. It basically uses FlaUI to search for tabs in your browser instances and allows you to open the tab within a click. No need to manually click through all your browser instances. Kinda like the launchers everyone knows, just for browser tabs.

I use AutoKey on Linux. It's less powerful than AHK but uses native Python which is nice: https://github.com/autokey/autokey

On Linux, the more direct equivalent to AHK is the similarly named AutoKey. AHK itself is never going to be cross-platform, due to the low-level it interacts specifically with Windows, but AutoKey is the Linux equivalent, designed to interact low-level with Linux in a similar way to AHK on Windows.

https://github.com/autokey/autokey ​

You can also try remapping mouse buttons. I use autohotkey to remap the middle clock to the right click. Autohotkey is windows only, but there is autokey which might help if you are a heavy middle click user like me

GitHub - autokey/autokey: AutoKey, a desktop automation utility for Linux and X11.