Zero-Shot Prediction Plugin for FiftyOne

This page summarizes the projects mentioned and recommended in the original post on dev.to

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • twilio-automation-plugin

    Automate data ingestion into FiftyOne with Twilio

  • Week 1: 🎨 AI Art Gallery & Twilio Automation

  • ten-weeks-of-plugins

    My journey during 10 weeks of building FiftyOne plugins

  • def _execution_mode(ctx, inputs): delegate = ctx.params.get("delegate", False) if delegate: description = "Uncheck this box to execute the operation immediately" else: description = "Check this box to delegate execution of this task" inputs.bool( "delegate", default=False, required=True, label="Delegate execution?", description=description, view=types.CheckboxView(), ) if delegate: inputs.view( "notice", types.Notice( label=( "You've chosen delegated execution. Note that you must " "have a delegated operation service running in order for " "this task to be processed. See " "https://docs.voxel51.com/plugins/index.html#operators " "for more information" ) ), ) def resolve_delegation(self, ctx): return ctx.params.get("delegate", False)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • zero-shot-prediction-plugin

    Run zero-shot prediction models on your data

  • fiftyone plugins download https://github.com/jacobmarks/zero-shot-prediction-plugin

  • super-gradients

    Easily train or fine-tune SOTA computer vision models with one open source training library. The home of Yolo-NAS.

  • Most computer vision models are trained to predict on a preset list of label classes. In object detection, for instance, many of the most popular models like YOLOv8 and YOLO-NAS are pretrained with the classes from the MS COCO dataset. If you download the weights checkpoints for these models and run prediction on your dataset, you will generate object detection bounding boxes for the 80 COCO classes.

  • CLIP

    CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

  • In computer vision, this is known as zero-shot learning, or zero-shot prediction, because the goal is to generate predictions without explicitly being given any example predictions to learn from. With the advent of high quality multimodal models like CLIP and foundation models like Segment Anything, it is now possible to generate remarkably good zero-shot predictions for a variety of computer vision tasks, including:

  • segment-anything

    The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

  • In computer vision, this is known as zero-shot learning, or zero-shot prediction, because the goal is to generate predictions without explicitly being given any example predictions to learn from. With the advent of high quality multimodal models like CLIP and foundation models like Segment Anything, it is now possible to generate remarkably good zero-shot predictions for a variety of computer vision tasks, including:

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts