FlaUI VS SikuliX1

If you are looking to automate this all through the GUI of each app involved then I suggest using FlaUI or some other wrapper around UIA

FlaUI

The best open-source library for writing UIA for native Windows desktop apps is FlaUI if you find the problem space interesting. I started learning about all types of UIA when I started at a company doing QA work. Now I worked on UIA because I learned from my experience how bad UIA support is in most applications, and I am disappointed that people who are disabled have that to look forward to, not to mention that if my hands were ever crushed or some other maiming were to occur, I would be depending on UIA as well. Since that realization, I have tried to get more developers interested in UI automation and its quality, not just because of its effect on others with disabilities but because it benefits anyone in our profession to have that safety.

Alternatively if you're into dotnet, FlaUI is amazing for automation and gives you a sane environment. I moved to it when I couldn't deal with AutoIT scripts anymore and it's everything I needed. https://github.com/FlaUI/FlaUI

I would suggest taking a look at FlaUI https://github.com/FlaUI/FlaUI

What comes to mind is something like this one: https://github.com/FlaUI/FlaUI I don't think it can do the "search image on screen" part. A smooth mouse movement is only a series of mouse teleports, so that should be coded relatively easy. If you really don't know where the image is on screen and it also does not have a id to search for then it will be a little harder I guess. Like making a screenshot and putting it into some image processing library? Probably there are easier solutions out there

Is it possible to control another program via code? This link says yes and the following is the successor of what they originally recommended: https://github.com/FlaUI/FlaUI.

If you're like me and have way too many tabs open and then get lost whenever you need to access that one tab quickly again, then this software might help you. It basically uses FlaUI to search for tabs in your browser instances and allows you to open the tab within a click. No need to manually click through all your browser instances. Kinda like the launchers everyone knows, just for browser tabs.

I've been using SikuliX [1] instead of AHK for a while now, only downside is that it uses jython so it's stuck on 2.7, but I don't use it for anything complicated enough that it really matters. Also I mainly use it for long running, rarely used automation, so I'm not sure how it would compare in terms of responsiveness for tasks like text expansion.

Also I did a quick search and I assume this [2] is the library you mentioned?

[1] https://github.com/RaiMan/SikuliX1

Still looking? If you are, I could try with my Sikuli experience; otherwise you can add the solved flair.

[error] RunTime:loadLib: libopencv_java430.so (failed) probably dependent libs missing: Can't load library: /root/.Sikulix/SikulixLibs/libopencv_java430.so [error] Save your work, correct the problem and restart the IDE! [error] see: [URL]https://github.com/RaiMan/SikuliX1/wiki/macOS-Linux:-Support-Libraries-for-OpenCV-4[/URL] TERMINATING: problem with native library: libopencv_java430.so [error] script [ click_image ] stopped with error in line 1 [error] java.lang.ExceptionInInitializerError ( java.lang.ExceptionInInitializerError ) [error] --- Traceback --- error source first line: module ( function ) statement 1: main ( ) click("1656348124939.png") [error] --- Traceback --- end --------------

I believe https://github.com/RaiMan/SikuliX1 automate any kind of app