Python multimodality

Open-source Python projects categorized as multimodality

Top 9 Python multimodality Projects

multimodality
  1. big-sleep

    A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

  2. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  3. Cradle

    The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

    Project mention: Cradle framework: a first attempt at General Computer Control (GCC) | news.ycombinator.com | 2024-07-15
  4. FEDOT

    Automated modeling and machine learning framework FEDOT

  5. Woodpecker

    ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models (by BradyFU)

  6. GPT4RoI

    GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest

  7. LLM2CLIP

    LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.

    Project mention: LLM2CLIP: Powerful Language Model Unlocks Richer Visual Representation | news.ycombinator.com | 2024-11-18
  8. clip-guided-diffusion

    A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. dance

    DANCE: a deep learning library and benchmark platform for single-cell analysis (by OmicsML)

  11. LIMoE-pytorch

    PyTorch implementation of LIMoE

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python multimodality discussion

Log in or Post with

Python multimodality related posts

  • Is creating a StableDiffusion-inspired model feasible for my Master's thesis?

    1 project | /r/StableDiffusion | 31 Mar 2023
  • TEDx talk on how to prepare for a career in vfx with the rapid changes caused by AI / machine learning

    1 project | /r/vfx | 24 Mar 2023
  • Any good ai art websites that work with pokemon?

    1 project | /r/pokemon | 6 Sep 2022
  • Explore generative art with me

    1 project | /r/codepairing | 20 Jul 2022
  • What do you guys think of LaMDA?

    1 project | /r/Technomancy | 6 Jul 2022
  • GitHub - lucidrains/big-sleep: A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

    1 project | /r/cryptogeum | 4 Jun 2022
  • Jag gav ett AI program ordet "Sweden"

    1 project | /r/sweden | 25 Apr 2022
  • A note from our sponsor - CodeRabbit
    coderabbit.ai | 23 Mar 2025
    Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR. Learn more →

Index

What are some of the best open-source multimodality projects in Python? This list will help you:

# Project Stars
1 big-sleep 2,569
2 Cradle 2,040
3 FEDOT 662
4 Woodpecker 632
5 GPT4RoI 523
6 LLM2CLIP 482
7 clip-guided-diffusion 461
8 dance 354
9 LIMoE-pytorch 53

Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai

Did you know that Python is
the 2nd most popular programming language
based on number of references?