falkon
pytorch-lightning
| falkon | pytorch-lightning | |
|---|---|---|
| 3 | 1 | |
| 173 | 18,249 | |
| 1.7% | - | |
| 8.0 | 9.9 | |
| 12 days ago | about 2 years ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
falkon
-
[Research] Optimizing a kernel matrix
As a satisfied customer (thanks!), was about to recommend KeOps as well. It might also be worth looking into falkon which builds on KeOps and leverages Nystrom approximation and conjugate gradient optimisation to further scale kernel operations.
-
[D] Have we abandoned kernels?
On the computational side, it is also important to note that kernel methods are now 100-1,000 faster than they were just three years ago. You may be interested by the KeOps library, which is to kernels and geometric ML what cuDNN is to convolutions. You could also have a look at GPyTorch and the Falkon solvers: the software bottlenecks that were holding back kernel methods are progressively being lifted. Million-scale datasets are now routinely processed in minutes/hours and billion-scale problems are starting to become tractable.
-
[D] why did kernel methods become less popular than neural networks?
On this note, you may be interested by the KeOps library (which is to kernels/geometric ML what cuDNN is to CNNs) and the Falkon solvers: the software bottlenecks that were holding back kernel methods are progressively being lifted. Million-scale datasets are now routinely processed in minutes/hours and billion-scale problems are starting to become tractable. This opens up quite a few possibilities :-)
pytorch-lightning
-
Introduction to PyTorch
PyTorch Lightning
What are some alternatives?
keops - KErnel OPerationS, on CPUs and GPUs, with autodiff and without memory overflows
spaCy - 💫 Industrial-strength Natural Language Processing (NLP) in Python
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
pytorch_geometric - Graph Neural Network Library for PyTorch [Moved to: https://github.com/pyg-team/pytorch_geometric]
pytorch-lightning - Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
data-centric-ai - Resources for Data Centric AI
PyTorch-NLP - Basic Utilities for PyTorch Natural Language Processing (NLP)
breaching - Breaching privacy in federated learning scenarios for vision and text
tutorials - PyTorch tutorials.
mlsync - Sync your ML data with your favorite productivity tools!
DI-star - An artificial intelligence platform for the StarCraft II with large-scale distributed training and grand-master agents.
FederatedScope - An easy-to-use federated learning platform