[P] Using PyTorch + NumPy? A bug that plagues thousands of open-source ML projects.

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • Pytorch

    Tensors and Dynamic neural networks in Python with strong GPU acceleration

  • But the problem doesn't occur when you use Python's random seeds, precisely because PyTorch sets the Python random seed (but not the Numpy one) in each worker: https://github.com/pytorch/pytorch/blob/98baad57642115d1f66723f6f10585ed933fd731/torch/utils/data/_utils/worker.py#L137, as mentioned in OP's post. So maybe the issue can be fixed by just setting the Numpy random seed like this in the Pytorch code base?

  • Kornia

    Geometric Computer Vision Library for Spatial AI

  • Use kornia.augmentation where this problem is solved doing the augmentations in batch outside the dataloader. https://github.com/kornia/kornia

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • CenterNet

    Object detection, 3D detection, and pose estimation using center point detection:

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts