Top 7 vqa Open-Source Projects

mmf

2 5,415 5.5 Python

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
InternGPT

5 3,128 8.8 Python

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

Project mention: How do I use the programs on Github? | /r/github | 2023-06-16

You can also create an issue and ask the developers for help.

InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
prismer

5 1,288 5.2 Python

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
Oscar

1 1,027 4.0 Python

Oscar and VinVL
Transformer-MM-Explainability

3 704 0.0 Jupyter Notebook

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.
Multi-Modality-Arena

1 364 7.7 Python

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!

Project mention: [R] Tiny LVLM-eHub: Early Multimodal Experiments with Bard - OpenGVLab, Shanghai AI Laboratory 2023 - Encourages innovative strategies aimed at advancing multimodal techniques! | /r/MachineLearning | 2023-08-13

Github: https://github.com/OpenGVLab/Multi-Modality-Arena

OmniFusion

1 188 8.7 Python

OmniFusion — a multimodal model to communicate using text and images

Project mention: FLaNK AI - 15 April 2024 | dev.to | 2024-04-15

SaaSHub

www.saashub.com featured

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).