PaddleNLP
LinkBERT
PaddleNLP | LinkBERT | |
---|---|---|
2 | 2 | |
11,423 | 389 | |
1.4% | - | |
9.8 | 1.8 | |
5 days ago | about 2 years ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
PaddleNLP
LinkBERT
-
[D] Fine tuning LLM - VM requirements.
I am quite new to this - at the stage of experimenting. I would like to fine tune some large language model like LinkBert for instance: https://github.com/michiyasunaga/LinkBERT
-
Stanford AI Researchers Propose ‘LinkBERT’: A New Pretraining Method That Improves Language Model Training with Document Links
Continue reading | Check out the paper, github and blog post
What are some alternatives?
PaddleOCR - Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and deployment among server, mobile, embedded and IoT devices)
CogVLM - a state-of-the-art-level open visual language model | 多模态预训练模型
ivy - The Unified AI Framework
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
DeepFaceLive - Real-time face swap for PC streaming or video calls
qagnn - [NAACL 2021] QAGNN: Question Answering using Language Models and Knowledge Graphs 🤖
devops-exercises - Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions
uform - Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️
ColossalAI - Making large AI models cheaper, faster and more accessible
LMFlow - An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
DeepFaceLab - DeepFaceLab is the leading software for creating deepfakes.
dalle-mini - DALL·E Mini - Generate images from a text prompt