LinkBERT
PaddleNLP
LinkBERT | PaddleNLP | |
---|---|---|
2 | 2 | |
389 | 11,448 | |
- | 1.7% | |
1.8 | 9.8 | |
about 2 years ago | 10 days ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
LinkBERT
-
[D] Fine tuning LLM - VM requirements.
I am quite new to this - at the stage of experimenting. I would like to fine tune some large language model like LinkBert for instance: https://github.com/michiyasunaga/LinkBERT
-
Stanford AI Researchers Propose ‘LinkBERT’: A New Pretraining Method That Improves Language Model Training with Document Links
Continue reading | Check out the paper, github and blog post
PaddleNLP
What are some alternatives?
CogVLM - a state-of-the-art-level open visual language model | 多模态预训练模型
PaddleOCR - Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and deployment among server, mobile, embedded and IoT devices)
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
ivy - The Unified AI Framework
qagnn - [NAACL 2021] QAGNN: Question Answering using Language Models and Knowledge Graphs 🤖
DeepFaceLive - Real-time face swap for PC streaming or video calls
uform - Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️
devops-exercises - Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions
LMFlow - An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
ColossalAI - Making large AI models cheaper, faster and more accessible
DeepFaceLab - DeepFaceLab is the leading software for creating deepfakes.
dalle-mini - DALL·E Mini - Generate images from a text prompt