tsdae
tm2tb
tsdae | tm2tb | |
---|---|---|
1 | 1 | |
3 | 49 | |
- | - | |
4.9 | 8.3 | |
8 days ago | 6 months ago | |
Python | Python | |
Apache License 2.0 | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tsdae
-
Tranformer-based Denoising AutoEncoder for ST Unsupervised pre-training
A new PyPI package for training sentence embedding models in just 2 lines.
The acquisition of sentence embeddings often necessitates a substantial volume of labeled data. However, in many cases and fields, labeled data is rarely accessible, and the procurement of such data is costly. In this project, we employ an unsupervised process grounded in pre-trained Transformers-based Sequential Denoising Auto-Encoder (TSDAE), introduced by the Ubiquitous Knowledge Processing Lab of Darmstadt, which can realize a performance level reaching 93.1% of in-domain supervised methodologies.
The TSDAE schema comprises two components: an encoder and a decoder. Throughout the training process, TSDAE translates tainted sentences into uniform-sized vectors, necessitating the decoder to reconstruct the original sentences utilizing this sentence embedding. For good reconstruction quality, the semantics must be captured well in the sentence embeddings from the encoder. Subsequently, during inference, the encoder is solely utilized to form sentence embeddings.
GitHub : https://github.com/louisbrulenaudet/tsdae
Installation :
tm2tb
-
TM2TB | Extract a term base from any bilingual document
It's open-source: https://github.com/luismond/tm2tb
What are some alternatives?
HyperGAN - Composable GAN framework with api and user interface
edenai-apis - Eden AI: simplify the use and deployment of AI technologies by providing a unique API that connects to the best possible AI engines
happy-transformer - Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.
lingvo - Lingvo
stopes - A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.
argos-translate - Open-source offline translation library written in Python
seq2seq - A general-purpose encoder-decoder framework for Tensorflow
refinery - The data scientist's open-source choice to scale, assess and maintain natural language data. Treat training data like a software artifact.