educational-transformer
awesome-pretrained-chinese-nlp-models
| educational-transformer | awesome-pretrained-chinese-nlp-models | |
|---|---|---|
| 1 | 1 | |
| 2 | 4,250 | |
| - | - | |
| 3.8 | 8.9 | |
| 8 months ago | about 18 hours ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
educational-transformer
awesome-pretrained-chinese-nlp-models
What are some alternatives?
DialoGPT - Large-scale pretraining for dialogue
ai_and_memory_wall - AI and Memory Wall
gpt-neo - An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
rust-bert - Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
RWKV-LM - RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
PaddleNLP - 👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
LoRA - Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
ERNIE-text-classification-pytorch - This repo contains a PyTorch implementation of a pretrained ERNIE model for text classification.
TencentPretrain - Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo