incubator-gluten
nougat
| incubator-gluten | nougat | |
|---|---|---|
| 3 | 13 | |
| 1,014 | 8,186 | |
| 5.5% | 4.5% | |
| 9.9 | 7.5 | |
| 5 days ago | about 1 month ago | |
| Scala | Python | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
incubator-gluten
-
A glimpse into the future of data processing infrastructure.
When I first learned about the Gluten project from Intel, I thought Databricks was going to be in trouble.
- FLaNK Stack for 04 December 2023
-
Blaze: Fast query execution engine for Apache Spark
Interesting, looks like it is just DataFusion engine for Spark. There is a similar project: https://github.com/oap-project/gluten - it brings ClickHouse as an engine to Spark.
nougat
-
Show HN: Talk to any ArXiv paper just by changing the URL
https://github.com/facebookresearch/nougat/tree/main
- FLaNK Stack for 04 December 2023
- Detexify LaTeX Handwriting Symbol Recognition
-
Pix2tex: Using a ViT to convert images of equations into LaTeX code
If you're looking for more e2e math / latex aware OCR checkout https://github.com/facebookresearch/nougat
- Nougat: Open-source LaTeX aware OCR for math-heavy books
-
Did anyone manage to get nougat running?
git clone --recurse-submodules https://github.com/facebookresearch/nougat.git PyProject
- Nougat: Facebook Research PDF to .mdd Model
-
Linear Book Scanner – The open-source automatic book scanner
> For the scientific literature, we need a ChatGPT equivalent to reconstruct LaTeX source that can reproduce each page. (We really need a successor to LaTeX that isn't such an arcane language, and can author fixed and flowable text with equal ease.)
Check out Nougat: OCRing scientific papers with a deep net trained end to end. It was released by Meta a few days ago.
“PDF format leads to a loss of semantic information, particularly for mathematical expressions. We propose Nougat (Neural Optical Understanding for Academic Documents), a Visual Transformer model that performs an Optical Character Recognition (OCR) task for processing scientific documents into a markup language, and demonstrate the effectiveness of our model on a new dataset of scientific documents.”
https://facebookresearch.github.io/nougat/
-
Nougat: Neural Optical Understanding for Academic Documents
The paper (and examples) as HTML: https://facebookresearch.github.io/nougat/
Repo with code, including a CLI tool for converting a PDF to Mathpix Markdown: https://github.com/facebookresearch/nougat
What are some alternatives?
LearningSparkV2 - This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
LIMoE-pytorch - PyTorch implementation of LIMoE
opaque-sql - An encrypted data analytics platform
libcolorpicker - Color Picker Library For iOS
blaze - Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.
typst - A new markup-based typesetting system that is powerful and easy to learn.
blaze - NumPy and Pandas interface to Big Data
advanced-brightness-slider-tweak - iOS Tweak that manipulates the brightness slider in the control center so the display brightness and the white point intensity can be modified
Jupyter Scala - A Scala kernel for Jupyter
NotiBlock - An iOS jailbreak tweak to write custom filters to block notifications
kyuubi - Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
LaTeX-OCR - pix2tex: Using a ViT to convert images of equations into LaTeX code.