FlaUI VS PyAutoGUI

If you are looking to automate this all through the GUI of each app involved then I suggest using FlaUI or some other wrapper around UIA

FlaUI

The best open-source library for writing UIA for native Windows desktop apps is FlaUI if you find the problem space interesting. I started learning about all types of UIA when I started at a company doing QA work. Now I worked on UIA because I learned from my experience how bad UIA support is in most applications, and I am disappointed that people who are disabled have that to look forward to, not to mention that if my hands were ever crushed or some other maiming were to occur, I would be depending on UIA as well. Since that realization, I have tried to get more developers interested in UI automation and its quality, not just because of its effect on others with disabilities but because it benefits anyone in our profession to have that safety.

Alternatively if you're into dotnet, FlaUI is amazing for automation and gives you a sane environment. I moved to it when I couldn't deal with AutoIT scripts anymore and it's everything I needed. https://github.com/FlaUI/FlaUI

I would suggest taking a look at FlaUI https://github.com/FlaUI/FlaUI

What comes to mind is something like this one: https://github.com/FlaUI/FlaUI I don't think it can do the "search image on screen" part. A smooth mouse movement is only a series of mouse teleports, so that should be coded relatively easy. If you really don't know where the image is on screen and it also does not have a id to search for then it will be a little harder I guess. Like making a screenshot and putting it into some image processing library? Probably there are easier solutions out there

Is it possible to control another program via code? This link says yes and the following is the successor of what they originally recommended: https://github.com/FlaUI/FlaUI.

If you're like me and have way too many tabs open and then get lost whenever you need to access that one tab quickly again, then this software might help you. It basically uses FlaUI to search for tabs in your browser instances and allows you to open the tab within a click. No need to manually click through all your browser instances. Kinda like the launchers everyone knows, just for browser tabs.

We will see how to take screenshot using python in desktop with the help of pyautogui package this package is used of GUI automation.

Just turn off the monitor https://github.com/asweigart/pyautogui/issues/681

This repository is implemented with reference to pyautogui.

If you can't solve the problem with fixing keyboard layout, there's some kinda workaround: https://github.com/asweigart/pyautogui/issues/249

This will be platform-specific, and will involve some OS-exposed APIs. I’m not familiar with windows and it sounds like that’s what you’re targeting, but check out the code for pyautogui to get you started. You’ll need to port it to C# (or find existing bindings).

PyAutoGUI could be useful to you: https://github.com/asweigart/pyautogui

That uses pyInstaller under the hood, which is supposed to resolve dependencies, but I don't see any imports for cv2 in the pyautogui source (https://github.com/asweigart/pyautogui)