DeBERTa
spokestack-python
| DeBERTa | spokestack-python | |
|---|---|---|
| 4 | 7 | |
| 1,847 | 132 | |
| 1.0% | - | |
| 3.6 | 3.3 | |
| 7 months ago | over 2 years ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
DeBERTa
-
🚀 Microsoft AI Introduce DeBERTa-V3: A Novel Pre-Training Paradigm for Language Models Based on the Combination of DeBERTa and ELECTRA
Quick Read: https://www.marktechpost.com/2023/03/23/microsoft-ai-introduce-deberta-v3-a-novel-pre-training-paradigm-for-language-models-based-on-the-combination-of-deberta-and-electra/ Paper: https://arxiv.org/pdf/2111.09543.pdf Github: https://github.com/microsoft/DeBERTa
-
How do I fine-tune zero shot models?
The obvious answer is to look at how the Deberta model was trained for MNLI and copy that: github
-
[D] Paper Explained - DeBERTa: Decoding-enhanced BERT with Disentangled Attention (Full Video Analysis)
Code: https://github.com/microsoft/DeBERTa
- DeBERTa-0.9b/1.5b checkpoints released (SuperGLUE score: 89.9%)
spokestack-python
-
We're making it super easy to use voice in Python, and we want your feedback!
Our AutoML service will let you [redacted because we're not ready to say it publicly yet], using your own voice. Combining [redacted] with existing open-source SDK libraries & tutorials for [Python](https://github.com/spokestack/spokestack-python) allows you to utilize cutting-edge personalized voice technology.
-
Sunday Daily Thread: What's everyone working on this week?
I’ve been working on this project for a while now. I’m really interested to discover if other developers want to add voice to their python projects.
I’ll be working on integrating spokestack into home-assistant
- Spokestack: Python Library for Voice Applications
- Spokestack: Embedded Voice Library for Python
-
I love home assistant and I work on TTS in my day job. Should I do an add-on or an integration?
Ok so that’s my main concern. It seems like for distribution an integration is the way to go. Library is this for better context.
- Python Embedded Voice Library
What are some alternatives?
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
picovoice - On-device voice assistant platform powered by deep learning
clip-as-service - 🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
silero-models - Silero Models: pre-trained speech-to-text, text-to-speech and text-enhancement models made embarrassingly simple
BERTweet - BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)
Porcupine - On-device wake word detection powered by deep learning
bertviz - BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
gector - Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)
Caffe2
sapbert - [NAACL'21 & ACL'21] SapBERT: Self-alignment pretraining for BERT & XL-BEL: Cross-Lingual Biomedical Entity Linking.
Serpent.AI - Game Agent Framework. Helping you create AIs / Bots that learn to play any game you own!