MetaCLIP
ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering (by facebookresearch)
NumPyCLIP
Pure NumPy implementation of https://github.com/openai/CLIP (by 99991)
| MetaCLIP | NumPyCLIP | |
|---|---|---|
| 5 | 1 | |
| 1,019 | 4 | |
| 4.6% | - | |
| 7.5 | 5.2 | |
| 12 days ago | 11 months ago | |
| Python | Python | |
| GNU General Public License v3.0 or later | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
MetaCLIP
Posts with mentions or reviews of MetaCLIP.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-03-13.
-
A History of CLIP Model Training Data Advances
(Github Repo | Most Popular Model | Paper)
-
How to Build a Semantic Search Engine for Emojis
Whenever I’m working on semantic search applications that connect images and text, I start with a family of models known as contrastive language image pre-training (CLIP). These models are trained on image-text pairs to generate similar vector representations or embeddings for images and their captions, and dissimilar vectors when images are paired with other text strings. There are multiple CLIP-style models, including OpenCLIP and MetaCLIP, but for simplicity we’ll focus on the original CLIP model from OpenAI. No model is perfect, and at a fundamental level there is no right way to compare images and text, but CLIP certainly provides a good starting point.
- MetaCLIP by Meta AI Research
- MetaCLIP – Meta AI Research
NumPyCLIP
Posts with mentions or reviews of NumPyCLIP.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-10-26.
-
MetaCLIP – Meta AI Research
I found CLIP to be _amazing_ for all kinds of image search, like search-by-text or search-by-image. I even ported it to NumPy to understand it better. The whole thing is less than 500 lines of Python: https://github.com/99991/NumPyCLIP
What are some alternatives?
When comparing MetaCLIP and NumPyCLIP you can also consider the following projects:
blip-caption - Generate captions for images with Salesforce BLIP
autodistill-metaclip - MetaCLIP module for use with Autodistill.
BLIP - PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
open_clip - An open source implementation of CLIP.
emoji-search-plugin - Semantic Emoji Search Plugin for FiftyOne