FlaUI VS WinAppDriver

If you are looking to automate this all through the GUI of each app involved then I suggest using FlaUI or some other wrapper around UIA

FlaUI

The best open-source library for writing UIA for native Windows desktop apps is FlaUI if you find the problem space interesting. I started learning about all types of UIA when I started at a company doing QA work. Now I worked on UIA because I learned from my experience how bad UIA support is in most applications, and I am disappointed that people who are disabled have that to look forward to, not to mention that if my hands were ever crushed or some other maiming were to occur, I would be depending on UIA as well. Since that realization, I have tried to get more developers interested in UI automation and its quality, not just because of its effect on others with disabilities but because it benefits anyone in our profession to have that safety.

Alternatively if you're into dotnet, FlaUI is amazing for automation and gives you a sane environment. I moved to it when I couldn't deal with AutoIT scripts anymore and it's everything I needed. https://github.com/FlaUI/FlaUI

I would suggest taking a look at FlaUI https://github.com/FlaUI/FlaUI

What comes to mind is something like this one: https://github.com/FlaUI/FlaUI I don't think it can do the "search image on screen" part. A smooth mouse movement is only a series of mouse teleports, so that should be coded relatively easy. If you really don't know where the image is on screen and it also does not have a id to search for then it will be a little harder I guess. Like making a screenshot and putting it into some image processing library? Probably there are easier solutions out there

Is it possible to control another program via code? This link says yes and the following is the successor of what they originally recommended: https://github.com/FlaUI/FlaUI.

If you're like me and have way too many tabs open and then get lost whenever you need to access that one tab quickly again, then this software might help you. It basically uses FlaUI to search for tabs in your browser instances and allows you to open the tab within a click. No need to manually click through all your browser instances. Kinda like the launchers everyone knows, just for browser tabs.

We use WinAppDriver with appium https://github.com/microsoft/WinAppDriver We are no longer developing the desktop application, but our Azure devops pipeline is still running the tests.

It dead: https://github.com/microsoft/WinAppDriver/issues/1550

First Download the WinAppDriver installer from https://github.com/Microsoft/WinAppDriver/releases

I started looking for UI testing solutions for desktop applications. I quickly discarded expensive UI testing suites. WinAppDriver was very interesting, but one of the requirements was to add some kind of identifiers on every UI element that we wanted to interact with. This would have required a huge effort from the team.

Appium and/or WinAppDriver are a newer alternative and pretty easy to use.

An automation tool to drive your application under test (AUT) - WinAppDriver & Appium

Check out WinAppDriver (Windows Application Driver) by Microsoft. I haven't had a chance to use it yet, but the repo (link) has good examples in it.