[D] Any pre trained retrieval based language models available?

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning
hardware-buttons scrape-images linkedin-bot

SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • RetGen

    You may look into RetGen by Microsoft. They have released model checkpoints too.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • retomaton

    PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)

  • RETRO-pytorch

    Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

    There's a Github project that an individual put together based on the RETRO paper. If you checkout the issues list there is some info on work on a pretrained model.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • [D] Is there an open-source implementation of the Retrieval-Enhanced Transformer (RETRO)?

    4 projects | /r/MachineLearning | 15 Jan 2022

  • Recapping the AI, Machine Learning and Computer Meetup — November 14, 2024

    2 projects | dev.to | 15 Nov 2024

  • El uso de los modelos de IA open source en el desarrollo

    2 projects | dev.to | 6 Nov 2024

  • OmniParser for Pure Vision Based GUI Agent

    2 projects | news.ycombinator.com | 26 Oct 2024

  • Voxel51 Filtered Views Newsletter - October 4, 2024

    1 project | dev.to | 4 Oct 2024

Did you konow that Python is
the 2nd most popular programming language
based on number of metions?