marionette VS tesseract

I've been doing some promoting of my side project by responding to posts/comments that are relevant with details about my project, but I don't know how often questions about what kind of automation frameworks there are come up. I told my coworker about your project after tracking it down, it sounds like it may be somewhat similar to something we homebrewed and we can possibly make use of https://github.com/asimmon/askaiser-marionette instead.

About a year ago, I started writing this test automation framework which is based on image and text recognition. Now that I've done quite a lot of testing and polishing, I've reached the point where I'd like to receive feedback from QA and software engineers. This is why I am asking for your help today:

So, give it a try, and take a look at the sample project! It only works on Windows, because screen capture, mouse and keyboard interaction are only implemented for that OS so far.

Tesseract OCR

In order to implement text recognition, I needed to use another library, Tesseract. It is an optical character recognition engine made by Google. There is also a .NET wrapper for this library. I had to use a few tricks to properly match arbitrary text with a library that is best suited for digitized books, and cleverly use page segmentation methods. You will find how I used Tesseract in this C# class.

I think OpenCV is probably not the right application for what you're trying to do. You might try Tesseract OCR. In my experience OCR can be great at recognition when it's based on a crisp screenshot (usually it starts to struggle with scanned/photographed images).

I'm playing around creating a xamarin app which can take a picture and then recognize the text. The xamarin project is pretty much done. I've OCR part of the app is done in regular c# / .NET (not xamarin), specifically the Tesseract .NET wrapper from Charles Weld. But I've encountered an error which i don't entirely understand and can't seem to resolve.