simpletransformers
BERTweet
Our great sponsors
simpletransformers | BERTweet | |
---|---|---|
6 | 1 | |
3,984 | 557 | |
- | 3.2% | |
7.3 | 2.6 | |
about 1 month ago | 5 months ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
simpletransformers
-
Huggingface is a great idea poorly executed.
You might try this: https://github.com/ThilinaRajapakse/simpletransformers
-
Gpt 2 124m using transformers
https://github.com/ThilinaRajapakse/simpletransformers/blob/master/simpletransformers/language_generation/language_generation_model.py#L146
-
Neural Search Tutorial
Getting embeddings from BERT Encoder
-
Neural Search Step-by-Step
Tutorial includes: - What is the Neural Search? - Getting embeddings from BERT Encoder - Using vector search engine Qdrant - Creating an API server with FastAPI.
-
Document Classification
If you want to do text classification hugging face transformers is great. There's also a simple version for it: https://github.com/ThilinaRajapakse/simpletransformers
-
A Shortly like user interface for GPT 2?
Here is an example script to finetune a GPT-2 model: https://github.com/ThilinaRajapakse/simpletransformers/blob/master/examples/language_generation/fine_tune.py
BERTweet
-
A pre-trained BERT-like model with recent events?
Not sure if that's what you are looking for, but BERTweet has model trained on tweets containing COVID keywords https://github.com/VinAIResearch/BERTweet
What are some alternatives?
minGPT - A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
DeBERTa - The implementation of DeBERTa
layout-parser - A Unified Toolkit for Deep Learning Based Document Image Analysis
CoWin-Vaccine-Notifier - Automated Python Script to retrieve vaccine slots availability and get notified when a slot is available.
kiri - Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.
nlu - 1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.
fastapi - FastAPI framework, high performance, easy to learn, fast to code, ready for production
rasa - 💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
covid-19-germany-gae - COVID-19 statistics for Germany. For states and counties. With time series data. Daily updates. Official RKI numbers.
Questgen.ai - Question generation using state-of-the-art Natural Language Processing algorithms
FARM - :house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.