continual-pretraining-nlp-vision
Code to reproduce experiments from the paper "Continual Pre-Training Mitigates Forgetting in Language and Vision" https://arxiv.org/abs/2205.09357 (by AndreaCossu)
course-content-dl
NMA deep learning course (by NeuromatchAcademy)
continual-pretraining-nlp-vision | course-content-dl | |
---|---|---|
1 | 4 | |
14 | 715 | |
- | 1.8% | |
4.8 | 8.4 | |
7 months ago | about 1 month ago | |
Jupyter Notebook | Jupyter Notebook | |
MIT License | Creative Commons Attribution 4.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
continual-pretraining-nlp-vision
Posts with mentions or reviews of continual-pretraining-nlp-vision.
We have used some of these posts to build our list of alternatives
and similar projects.
-
[2205.09357] Continual Pre-Training Mitigates Forgetting in Language and Vision
Code for https://arxiv.org/abs/2205.09357 found: https://github.com/AndreaCossu/continual-pretraining-nlp-vision
course-content-dl
Posts with mentions or reviews of course-content-dl.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-04-15.
-
Is deep learning really so annoying?
Can highly recommend the NeuroMatch Deep Learning course: https://deeplearning.neuromatch.io/ It’s a summer school, but all the content is available free, open source for you to do it whenever you want to.
-
AskScience AMA Series: We are seven leading scientists specializing in the intersection of machine learning and neuroscience, and we're working to democratize science education online. Ask Us Anything about computational neuroscience or science education!
https://github.com/NeuromatchAcademy/course-content https://github.com/NeuromatchAcademy/course-content-dl
-
We are Konrad Kording, Megan Peters, Brad Wyble, Dan Goodman, Gunnar Blohm, and Sean Escola, and we're a group of scientists who started a major, international online summer school aiming to democratize science education and make it accessible to all. Ask Us Anything!
If you'd like to learn more about it, you can check out last year's Comp Neuro course contents here, last year's Deep Learning course contents here, read the paper we wrote about the original NMA here, read our Nature editorial, or the Lancet article00074-0/fulltext) about us.
What are some alternatives?
When comparing continual-pretraining-nlp-vision and course-content-dl you can also consider the following projects:
gan-vae-pretrained-pytorch - Pretrained GANs + VAEs + classifiers for MNIST/CIFAR in pytorch.
course-content - NMA Computational Neuroscience course
vision-transformer-from-scratch - A Simplified PyTorch Implementation of Vision Transformer (ViT)
awesome-machine-unlearning - Awesome Machine Unlearning (A Survey of Machine Unlearning)