LaVIN
[NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models" (by luogen1996)
image2dsl
This repository contains the implementation of an Image to DSL (Domain Specific Language) model. The model uses a pre-trained Vision Transformer (ViT) as an encoder to extract image features and a custom Transformer Decoder to generate DSL code from the extracted features. (by mzbac)
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
LaVIN
Posts with mentions or reviews of LaVIN.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-04.
-
[R] LaVIN-lite: Training your own Multimodal Large Language Models on one single GPU with competitive performance! (Technical Details)
LaVIN code: https://github.com/luogen1996/LaVIN
-
Ai trained on photos
For LLM visual instruction, you can use LLaVA, LaVIN, or MiniGPT-4.
-
Looking for a pre trained food recognition model
Please read the rules before posting. If you want a model for visual instruction, use LLaVA, LaVIN, or MiniGPT-4.
- [R] LaVIN: Large Vision-Language Instructed Model
image2dsl
Posts with mentions or reviews of image2dsl.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-30.
-
Looking for a pre trained food recognition model
Sorry to be mean here, but I think your idea is doable. Basically, you can build an image to category model and then feed its output to a fine-tuned LLama. You can have a look at one of my experiments for image to text-> https://github.com/mzbac/image2dsl
What are some alternatives?
When comparing LaVIN and image2dsl you can also consider the following projects:
LLaVA - [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
MiniGPT-4 - Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
qlora - QLoRA: Efficient Finetuning of Quantized LLMs