A Picture Is Worth 170 Tokens: How Does GPT-4o Encode Images?

1. ComfyUI

   1 141 71,090 9.9 Python

   The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

   

   I bet you could get this working in https://github.com/comfyanonymous/ComfyUI

   I have done some other LLava stuff in it

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. doctr

   2 13 4,412 8.8 Python

   docTR (Document Text Recognition) - a seamless, high-performing & accessible library for OCR-related tasks powered by Deep Learning.

   

   checkout https://github.com/mindee/doctr or https://github.com/VikParuchuri/surya for something practical

   multimodal llm would of course blow it all out the water, so some llama3-like model is probably SOTA in terms of what you can run yourself. something like https://huggingface.co/blog/idefics2

4. surya

   3 16 16,789 9.7 Python

   OCR, layout analysis, reading order, table recognition in 90+ languages

   

   checkout https://github.com/mindee/doctr or https://github.com/VikParuchuri/surya for something practical

   multimodal llm would of course blow it all out the water, so some llama3-like model is probably SOTA in terms of what you can run yourself. something like https://huggingface.co/blog/idefics2

5. seeV

   4 1 26 7.5 Swift

   A macOS command line wrapper around the Apple Vision framework

   

   I also wrote a Swift CLI that wraps over the Vision framework: https://github.com/nexuist/seev

   Text extraction is included (including the ability to specify custom words not found in the dictionary) but there are also utilities for face detection, classification, etc.

6. unilm

   5 44 20,889 8.2 Python

   Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

   

   Has anyone tried Kosmos [0] ? I came across it the other day and it looked shiny and interesting, but I haven't had a chance to put it to the test much yet.

   [0] - https://github.com/microsoft/unilm/tree/master/kosmos-2.5

7. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

Suggest a related project