Top 12 Python robertum Projects

• LoRA

  34 8,956 5.4 Python

  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

  

Project mention: DECT NR+: A technical dive into non-cellular 5G | news.ycombinator.com | 2024-04-02

This seems to be an order of magnitude better than LoRa (https://lora-alliance.org/ not https://arxiv.org/abs/2106.09685). LoRa doesn't have all the features this one does like OFDM, TDM, FDM, and HARQ. I didn't know there's spectrum dedicated for DECT use.

• bertviz

  15 6,377 3.9 Python

  BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Project mention: StreamingLLM: tiny tweak to KV LRU improves long conversations | news.ycombinator.com | 2024-02-13

This seems only to work cause large GPTs have redundant, undercomplex attentions. See this issue in BertViz about attention in Llama: https://github.com/jessevig/bertviz/issues/128

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• awesome-pretrained-chinese-nlp-models

  1 4,193 8.9 Python

  Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

• news-please

  1 1,925 7.3 Python

  news-please - an integrated web crawler and information extractor for news that just works

• DeBERTa

  4 1,844 3.6 Python

  The implementation of DeBERTa

  

• FARM

  3 1,723 0.0 Python

  :house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

  

• TencentPretrain

  1 975 7.8 Python

  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• gector

  2 863 0.0 Python

  Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

  

• BERTweet

  1 556 2.6 Python

  BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

  

• happy-transformer

  1 497 9.0 Python

  Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

• TEAM

  2 23 10.0 Python

  Our EMNLP 2022 paper on MCQA (by declare-lab)

  

• sequence-classifier

  1 0 6.7 Python

  A PyTorch Library for Sequence Labeling Tasks such as Named-entity Recognition or Part-of-speech Tagging

Project mention: Show HN: Sequence-Classifier, a PyTorch Library for Sequence Classification | news.ycombinator.com | 2023-12-13

Python roberta related posts

• 🚀 Microsoft AI Introduce DeBERTa-V3: A Novel Pre-Training Paradigm for Language Models Based on the Combination of DeBERTa and ELECTRA
  1 project | /r/machinelearningnews | 23 Mar 2023
• [R] Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering
  2 projects | /r/MachineLearning | 7 Jan 2023
• How do I fine-tune zero shot models?
  1 project | /r/LanguageTechnology | 23 Oct 2021
• A pre-trained BERT-like model with recent events?
  1 project | /r/LanguageTechnology | 24 Jun 2021
• [D] Paper Explained - DeBERTa: Decoding-enhanced BERT with Disentangled Attention (Full Video Analysis)
  1 project | /r/MachineLearning | 25 Feb 2021
• DeBERTa-0.9b/1.5b checkpoints released (SuperGLUE score: 89.9%)
  1 project | /r/mlscaling | 3 Feb 2021
• A note from our sponsor - WorkOS
  workos.com | 25 Apr 2024

  The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!