relora
question_generation
| relora | question_generation | |
|---|---|---|
| 2 | 4 | |
| 399 | 1,072 | |
| - | - | |
| 8.3 | 0.0 | |
| 20 days ago | about 1 month ago | |
| Jupyter Notebook | Jupyter Notebook | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
relora
- ReLoRA: High-Rank Training Through Low-Rank Updates
-
Aurelian: 70B 32K story-writing (and more) [Alpha]
Similarly, the dominant components selected before training may change order as you train. ReLORA is basically a way to re-align and make sure you are always training something close to the current most important params.
question_generation
-
Yes/No style Question and Answer Generation
I have seen models which do something similar but the questions they ask are not in a Yes/No style such as this T5 - based Question Generator. Essentially, I was wondering how I would go about developing such a model.
-
Best solution to make static chatbot for a minecraft server?
I've been able to get good domain-specific performance out of RoBERTa by training it on SQuAD (general QA) and synthetic domain-specific data created via https://github.com/patil-suraj/question_generation, took about 1000 domain-specific QA pairs.
-
State of the art models for Question generation
Not sure if it's SOTA but this project and paper is really interesting and quite easy to use : https://github.com/patil-suraj/question_generation
-
How could I go about turning a bunch of text into a series of questions with answers?
Take a look at https://github.com/patil-suraj/question_generation . It's a T5 model that tuned for generating questions for multiple formats (reading comprehension, multiple choice, cloze, etc) given an input text.
What are some alternatives?
LongLoRA - Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
FLAML - A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
adanet - Fast and flexible AutoML with learning guarantees.
mt5-M2M-comparison - Comparing M2M and mT5 on a rare language pairs, blog post: https://medium.com/@abdessalemboukil/comparing-facebooks-m2m-to-mt5-in-low-resources-translation-english-yoruba-ef56624d2b75
gluon-nlp - NLP made easy
practical-pytorch - Go to https://github.com/pytorch/tutorials - this repo is deprecated and no longer maintained
keytotext - Keywords to Sentences
mgpt - Multilingual Generative Pretrained Model
Questgen.ai - Question generation using state-of-the-art Natural Language Processing algorithms