nougat
LIMoE-pytorch
| nougat | LIMoE-pytorch | |
|---|---|---|
| 13 | 1 | |
| 8,062 | 46 | |
| 3.1% | - | |
| 7.5 | 2.5 | |
| 20 days ago | about 1 month ago | |
| Python | Python | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nougat
-
Show HN: Talk to any ArXiv paper just by changing the URL
https://github.com/facebookresearch/nougat/tree/main
- FLaNK Stack for 04 December 2023
- Detexify LaTeX Handwriting Symbol Recognition
-
Pix2tex: Using a ViT to convert images of equations into LaTeX code
If you're looking for more e2e math / latex aware OCR checkout https://github.com/facebookresearch/nougat
- Nougat: Open-source LaTeX aware OCR for math-heavy books
-
Did anyone manage to get nougat running?
git clone --recurse-submodules https://github.com/facebookresearch/nougat.git PyProject
- Nougat: Facebook Research PDF to .mdd Model
-
Linear Book Scanner – The open-source automatic book scanner
> For the scientific literature, we need a ChatGPT equivalent to reconstruct LaTeX source that can reproduce each page. (We really need a successor to LaTeX that isn't such an arcane language, and can author fixed and flowable text with equal ease.)
Check out Nougat: OCRing scientific papers with a deep net trained end to end. It was released by Meta a few days ago.
“PDF format leads to a loss of semantic information, particularly for mathematical expressions. We propose Nougat (Neural Optical Understanding for Academic Documents), a Visual Transformer model that performs an Optical Character Recognition (OCR) task for processing scientific documents into a markup language, and demonstrate the effectiveness of our model on a new dataset of scientific documents.”
https://facebookresearch.github.io/nougat/
-
Nougat: Neural Optical Understanding for Academic Documents
The paper (and examples) as HTML: https://facebookresearch.github.io/nougat/
Repo with code, including a CLI tool for converting a PDF to Mathpix Markdown: https://github.com/facebookresearch/nougat
LIMoE-pytorch
-
Pix2tex: Using a ViT to convert images of equations into LaTeX code
Makes me wonder what the SOTA is for open source efforts along these lines.
I have heard about "mixture of experts" as being a potentially important advance, and also of course about multimodality. So I found this: https://github.com/YeonwooSung/LIMoE-pytorch
What are some alternatives?
libcolorpicker - Color Picker Library For iOS
latex2sympy - Parse LaTeX math expressions
typst - A new markup-based typesetting system that is powerful and easy to learn.
LaTeX-OCR - pix2tex: Using a ViT to convert images of equations into LaTeX code.
advanced-brightness-slider-tweak - iOS Tweak that manipulates the brightness slider in the control center so the display brightness and the white point intensity can be modified
NotiBlock - An iOS jailbreak tweak to write custom filters to block notifications
HSWidgets - Add options to display widgets right on your homescreen.
MonkeyDev - CaptainHook Tweak、Logos Tweak and Command-line Tool、Patch iOS Apps, Without Jailbreak.
TeX-Match - Search through over 1000 different LaTeX symbols by sketching. A desktop version of detexify.
narrator - David Attenborough narrates your life