nougat VS MonkeyDev

https://github.com/facebookresearch/nougat/tree/main

If you're looking for more e2e math / latex aware OCR checkout https://github.com/facebookresearch/nougat

git clone --recurse-submodules https://github.com/facebookresearch/nougat.git PyProject

> For the scientific literature, we need a ChatGPT equivalent to reconstruct LaTeX source that can reproduce each page. (We really need a successor to LaTeX that isn't such an arcane language, and can author fixed and flowable text with equal ease.)

Check out Nougat: OCRing scientific papers with a deep net trained end to end. It was released by Meta a few days ago.

“PDF format leads to a loss of semantic information, particularly for mathematical expressions. We propose Nougat (Neural Optical Understanding for Academic Documents), a Visual Transformer model that performs an Optical Character Recognition (OCR) task for processing scientific documents into a markup language, and demonstrate the effectiveness of our model on a new dataset of scientific documents.”

https://facebookresearch.github.io/nougat/

The paper (and examples) as HTML: https://facebookresearch.github.io/nougat/

Repo with code, including a CLI tool for converting a PDF to Mathpix Markdown: https://github.com/facebookresearch/nougat

I can't read a lot of that project, but what I can doesn't look like you'll be able to do that on an iPhone. If you look at the installation section, it's expecting you to be building this on a mac: https://github.com/AloneMonkey/MonkeyDev/wiki/Installation (that isn't called out explicitly, but it's implicit in the commands they're running). "Easy to install" in this case seems to be for someone who is familiar with writing custom iOS applications and has a development setup for that already.

Theos is the easiest way to do it imo but you can still use Xcode with something like MonkeyDev if you want to. Either way you'll need to install theos