Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 6 visual-question-answering Open-Source Projects
-
BLIP
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
-
OFA
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
flamingo-pytorch
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
-
UPop
[ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
I suggest trying BLIP for this. I've had really good results from that.
https://github.com/salesforce/BLIP
I built a tiny Python CLI wrapper for it to make it easier to try: https://github.com/simonw/blip-caption
Project mention: Show HN: Compress vision-language and unimodal AI models by structured pruning | news.ycombinator.com | 2023-07-31
Week 2: ❓Visual Question Answering
visual-question-answering related posts
-
Is there a website where you can upload a photo and get the description in a paragraph?
-
Stable Diffusion v2-1-unCLIP model released
-
GPT-4 shows emergent Theory of Mind on par with an adult. It scored in the 85+ percentile for a lot of major college exams. It can also do taxes and create functional websites from a simple drawing
-
meme
-
Object Recognition for Photo Metadata
-
Stable-diffusion in Nix
-
I have a problem with the "interrogate" function of Automatic1111's fork. Can someone help me?
-
A note from our sponsor - InfluxDB
www.influxdata.com | 16 May 2024
Index
What are some of the best open-source visual-question-answering projects? This list will help you:
Project | Stars | |
---|---|---|
1 | BLIP | 4,302 |
2 | OFA | 2,337 |
3 | flamingo-pytorch | 1,134 |
4 | UPop | 82 |
5 | WSDMCup2023 | 29 |
6 | vqa-plugin | 13 |
Sponsored