vision-language-transformer

Open-source projects categorized as vision-language-transformer
Edit details
Language: + Python + Jupyter Notebook
Topics: image-captioning object-detection open-world visual-question-answering visual-reasoning
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 5 vision-language-transformer Open-Source Projects

  • LAVIS

    LAVIS - A One-stop Library for Language-Vision Intelligence

    • Project mention: FLaNK AI for 11 March 2024 | dev.to | 2024-03-11

  • GroundingDINO

    Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

    • Project mention: Autodistill: A new way to create CV models | /r/developersIndia | 2023-09-30

    Some of the foundation/base models include: * GroundedSAM (Segment Anything Model) * DETIC * GroundingDINO

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • BLIP

    PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

    • Project mention: MetaCLIP – Meta AI Research | news.ycombinator.com | 2023-10-26

    I suggest trying BLIP for this. I've had really good results from that.

    https://github.com/salesforce/BLIP

    I built a tiny Python CLI wrapper for it to make it easier to try: https://github.com/simonw/blip-caption

  • APE

    [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception (by shenyunhang)

    • Project mention: Image-to-Caption Generator | /r/computervision | 2023-12-07

    https://github.com/shenyunhang/APE (super new, idk usability on this one yet)

  • UPop

    [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.

    • Project mention: Show HN: Compress vision-language and unimodal AI models by structured pruning | news.ycombinator.com | 2023-07-31

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

vision-language-transformer related posts

  • Is there a way to do segmentation of a person's clothing?

    2 projects | /r/StableDiffusion | 22 May 2023

  • [D] Object Detection Machine Learning

    1 project | /r/MachineLearning | 25 Apr 2023

Index

What are some of the best open-source vision-language-transformer projects? This list will help you:

Project Stars
1 LAVIS 8,781
2 GroundingDINO 5,075
3 BLIP 4,278
4 APE 424
5 UPop 82

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com