Our great sponsors
-
lightning-hydra-template
PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
I write a LightningDatamodule. I found it to be an intuitive way to encapsulate any dataset. LightningDatamodule is a simple abstraction providing methods for data download, split, transforms and exposing dataloaders. Would love to see more researchers try out this concept, even in projects which don't use pytorch lightning. Reading LightningDatamodule makes me immedietely see how the dataset is prepared, while it seems like most data science projects throw around data logic across different parts of the pipeline, making it hard to understand what's going on. You can see example of such datamodule here
Related posts
- [D] Is Pytorch Lightning + Wandb a good combination for research?
- How research scientists structure their code ?
- [D] Any research specific PyTorch based boilerplate code?
- Typing and testing for torch
- Our template to kickstart your pytorch projects, with list of best practices. Minimal boilerplate code. Leverages Lightning + Hydra. Focused on scalability, reproducibility and fast experimentation.