zero-shot-retrieval

Open-source projects categorized as zero-shot-retrieval
Edit details
Language: + Python + Jupyter Notebook
Topics: Benchmark zero-shot-classification vision-transformer embedding-evaluation video-question-answering
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 3 zero-shot-retrieval Open-Source Projects

zero-shot-retrieval

  • beir

    A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

    • Project mention: On building a semantic search engine | news.ycombinator.com | 2024-01-06

    The BEIR project might be what you're looking for: https://github.com/beir-cellar/beir/wiki/Leaderboard

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo

  • InternVideo

    Video Foundation Models & Data for Multimodal Understanding

  • text-to-image-eval

    Evaluate custom and HuggingFace text-to-image/zero-shot-image-classification models like CLIP, SigLIP, DFN5B, and EVA-CLIP. Metrics include Zero-shot accuracy, Linear Probe, Image retrieval, and KNN accuracy.

    • Project mention: We Built an Open-Source Text-to-Image Evaluation Library for Clip Models | news.ycombinator.com | 2024-05-07

    Hi everyone,

    We recently released TTI Eval `text-to-image-eval`, an open-source library for evaluating zero-shot classification models like CLIP and domain-specific ones like BioCLIP against your (or HF) datasets to estimate how well the model will perform.

    You can evaluate custom and HuggingFace text-to-image/zero-shot image classification models like CLIP, SigLIP, DFN5B, and EVA-CLIP. The evaluation metrics include Zero-shot accuracy, linear probe, image retrieval, and KNN accuracy.

    We built this for ML engineers and developers using CLIP models.

    Here's the installation guide if you want to get started: https://github.com/encord-team/text-to-image-eval?tab=readme...

    I'd love to hear your thoughts on this. I'm open to contributions and feedback from the community.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

zero-shot-retrieval discussion

Log in or Post with

Index

What are some of the best open-source zero-shot-retrieval projects? This list will help you:

Project Stars
1 beir 1,438
2 InternVideo 1,042
3 text-to-image-eval 22

Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com