notebooks
fastai
notebooks | fastai | |
---|---|---|
2 | 9 | |
24 | 25,665 | |
- | 0.7% | |
0.0 | 8.0 | |
over 1 year ago | 17 days ago | |
Jupyter Notebook | Jupyter Notebook | |
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
notebooks
-
Neuromorphic learning, working memory, and metaplasticity in nanowire networks
This gives you a ludicrous advantage over current neural net accelerators. Specifically 3-5 orders is magnitude in energy and time, as demonstrated in the BranScaleS system https://www.humanbrainproject.eu/en/science-development/focu...
Unfortunately, that doesn't solve the problem of learning. Just because you can build efficient neuromorphic systems doesn't mean that we know how to train them. Briefly put, the problem is that a physical system has physical constraints. You can't just read the global state in NWN and use gradient descent as we would in deep learning. Rather, we have to somehow use local signals to approximate local behaviour that's helpful on a global scale. That's why they use Hebbian learning in the paper (what fires together, wires together), but it's tricky to get right and I haven't personally seen examples that scale to systems/problems of "interesting" sizes. This is basically the frontier of the field: we need local, but generalizable, learning rules that are stable across time and compose freely into higher-order systems.
Regarding educational material, I'm afraid I haven't seen great entries for learning about SNNs in full generality. I co-author a simulator (https://github.com/norse/norse/) based on PyTorch with a few notebook tutorials (https://github.com/norse/notebooks) that may be helpful.
I'm actually working on some open resources/course material for neuromorphic computing. So if you have any wishes/ideas, please do reach out. Like, what would a newcomer be looking for specifically?
-
Event-Based Backpropagation for Exact Gradients in Spiking Neural Networks
We've written some documentation around our neuron equations in Python that explains this: https://norse.github.io/norse/auto_api/norse.torch.functiona...
See also our tutorial on neuron parameter optimization to understand how it's useful for machine learning: https://github.com/norse/notebooks#level-intermediate
Disclaimer: I'm a co-author of the library Norse
Regarding the target audience, it's actually not entirely clear to me. This lies in the intersection between computational neuroscience and deep learning. Which isn't a huge set of people. Meaning, you're questions are valid and we (as researchers) have a lot of communication to do to explain why this is interesting and important.
fastai
-
Cleared AWS Machine Learning - Specialty exam.. Happy to help!!!
Jeremy Howard's YouTube Channel - Jeremy maintains the fastai library, which is an excellent package that will help anyone build complicated ML architectures in minimum time. His YouTube Channel has a number of free courses which do an amazing job of covering a variety of ML topics, and he also maintains a very active forum for people studying ML.
-
Coding your own AI in 2023 with fastai
To create the AI we will use fastai. This is a python library, which is build on top of pytorch. No worries, you don't need to know how to code python. We will learn how this stuff works along the way :)
-
Fast.ai starts a corporate partnership program
You may know fast.ai as a popular deep learning course. There is also a deep learning library with the same name (https://github.com/fastai/fastai) as well as software development tools like nbdev (https://nbdev.fast.ai/).
fast.ai has been offering education and tools for free for over 7 years, and has been approached by many companies asking for help. This program offers an avenue for business to get relevant professional services and support.
-
People tricking ChatGPT “like watching an Asimov novel come to life”
The "fastai" course is free, and does a really nice job walking you through building simple neural nets from the ground up:
https://github.com/fastai/fastai
What's going on here is the exact same thing, just much, much larger.
- Programação letrada com Jupyter Notebook e Nbdev
-
Why noone uses nbdev for library development?
Development NB: https://github.com/fastai/fastai/blob/master/nbs/09_vision.augment.ipynb
-
[D] What Repetitive Tasks Related to Machine Learning do You Hate Doing?
There is already a ton of momentum around automating ML workflows. I would suggest you contribute to a preexisting project like, for instance, PyTorch Lightning or fast.ai.
-
Good practices for neural network training: identify, save, and document best models
If you are unaware of what fastai is, its official description is:
-
D I Refuse To Use Pytorch Because Its A Facebook
Also, not a single docstring to document any code in the library - https://github.com/fastai/fastai/blob/master/fastai/vision/learner.py
What are some alternatives?
DeepLearningExamples - State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
NYU-DLSP20 - NYU Deep Learning Spring 2020
fastbook - The fastai book, published as Jupyter Notebooks
Made-With-ML - Learn how to design, develop, deploy and iterate on production-grade ML applications.
Watermark-Removal-Pytorch - 🔥 CNN for Watermark Removal using Deep Image Prior with Pytorch 🔥.
PySyft - Perform data science on data that remains in someone else's server
lego-mindstorms - My LEGO MINDSTORMS projects (using set 51515 electronics)
ru-dalle - Generate images from texts. In Russian
pytorch-lightning - Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
iterative-grabcut - This algorithm uses a rectangle made by the user to identify the foreground item. Then, the user can edit to add or remove objects to the foreground. Then, it removes the background and makes it transparent.
catam-julia - CATAM material in Julia