Pytorch-lightning Alternatives

Reviews and mentions

• [P] An introduction to PyKale https://github.com/pykale/pykale​, a PyTorch library that provides a unified pipeline-based API for knowledge-aware multimodal learning and transfer learning on graphs, images, texts, and videos to accelerate interdisciplinary research. Welcome feedback/contribution!
  reddit.com/r/MachineLearning | 2021-04-25

  If you want a good example for reference, take a look at Pytorch Lightning's readme (https://github.com/PyTorchLightning/pytorch-lightning) It answers the 3 questions of "what is this", "why should I care", and "how do i use it" almost instantly

• Pytorch Template
  reddit.com/r/pytorch | 2021-04-24
• [D] Advanced Takeaways from fast.ai book
  reddit.com/r/MachineLearning | 2021-03-23

  Lower precision training can help and on pytorch lightning is just a simple flag you can set

• [D] How to be more productive while doing Deep Learning experiments?
  reddit.com/r/MachineLearning | 2021-02-25

  First of all, use high-level ML frameworks (AllenNLP, PyTorch-Lightning). No need to write boilerplate code and implement standard ML approaches from scratch. Here are some suggestions (thought more NLP-focused) that I feel improved my research coding experience a lot.

• DDP with model parallelism with multi host multi GPU system
  reddit.com/r/pytorch | 2021-02-07
• PyTorch Lightning Flash appears to be copying fastai (without any credit) [D]
  reddit.com/r/MachineLearning | 2021-02-05

  According to the README it's patent pending, but I learned about that from this HN thread. Funny thing is I didn't even remember there was a snafu about patents, but looked it up because of some vague recollection of the PL founder getting into a tussle about some other trivial topic (apparently it was how well PyTorch works on TPUs).

• [D] Training 10x Larger Models and Accelerating Training with ZeRO-Offloading
  reddit.com/r/MachineLearning | 2021-01-25

  I also asked for the respective support in PytorchLightning in this issue: Add deepspeed support · Issue #817 · PyTorchLightning/pytorch-lightning (github.com)

• Nicest and cleanest Deep Learning codebases out there
  reddit.com/r/deeplearning | 2021-01-22

  When I look at the pytorch lightning animation, the stuff on the left for me is easy to follow and the code on the right formatted into classes is hard. My goal is to to start thinking and coding more like the code on the right. What I typically find hard with reading through code where everything is inside classes, methods, functions, decorators etc (i.e. the code on the right) is that there will be a place that executes all these methods in a linear way, but I keep having to scroll up to the class to see what it is actually doing. On the left I can just read through the code top to bottom. I even find myself copying the code out of classes the first time I read it so it executes like the code on the left :P I feel like what I'm doing is the equivalent of typing with only my index fingers…

• D I Refuse To Use Pytorch Because Its A Facebook
  reddit.com/r/MachineLearning | 2020-12-29

  You can use PyTorch Lightning to write less boilerplate

• Weekly Developer Roundup #23 - Sun Nov 22 2020
  dev.to | 2020-11-21

  PyTorchLightning/pytorch-lightning (Python): The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.