retomaton
PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022) (by neulab)
RETRO-pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch (by lucidrains)
| retomaton | RETRO-pytorch | |
|---|---|---|
| 1 | 2 | |
| 64 | 833 | |
| - | - | |
| 0.0 | 2.8 | |
| almost 2 years ago | 7 months ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
retomaton
Posts with mentions or reviews of retomaton.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-10-22.
RETRO-pytorch
Posts with mentions or reviews of RETRO-pytorch.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-10-22.
-
[D] Any pre trained retrieval based language models available?
There's a Github project that an individual put together based on the RETRO paper. If you checkout the issues list there is some info on work on a pretrained model.
-
[D] Is there an open-source implementation of the Retrieval-Enhanced Transformer (RETRO)?
i'll give it a shot https://github.com/lucidrains/RETRO-pytorch 👍
What are some alternatives?
When comparing retomaton and RETRO-pytorch you can also consider the following projects:
RetGen
CoCa-pytorch - Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
quaterion - Blazing fast framework for fine-tuning similarity learning models
TorchPQ - Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda
VeRyPy - A python library with implementations of 15 classical heuristics for the capacitated vehicle routing problem.
faiss - A library for efficient similarity search and clustering of dense vectors.
beir - A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
deepmind-research - This repository contains implementations and illustrative code to accompany DeepMind publications