deepmind-research VS Pytorch

Deepmind 63

Found some here and here.

I am trying to make a physics-simulation model based on DeepMind's research, with its source code found here https://github.com/deepmind/deepmind-research/tree/master/learning_to_simulate . The thing that mainly confuses me is how to properly implement the embedding situation found at https://github.com/deepmind/deepmind-research/blob/master/learning_to_simulate/learned_simulator.py on lines 78 and 152.

Yes. There's a fair bit of research into using ML to generate 3D models. Early work, like Neural Radiance Fields (NeRF) generated a voxel model, which could be used for 3D printing, but it would be low resolution, like blowing up a tiny image vs an SVG vector file. However, more recent research can generate polygonal models from a video taken of a real object. Polygonal models are much better for 3D printing.

Skilful precipitation nowcasting using deep generative models of radar https://www.nature.com/articles/s41586-021-03854-z https://deepmind.com/blog/article/nowcasting https://github.com/deepmind/deepmind-research/tree/master/nowcasting

Github: https://github.com/deepmind/deepmind-research/tree/master/density_functional_approximation_dm21

BYOL - again, it seems that it's not optimized for running on multiple GPUs.

PyTorch (https://pytorch.org/)

torch is a package to manage tensors and dynamic neural networks in python (GitHub)

PyTorch also has some support for them, but it's quite incomplete and has many issues so that it is basically unusable. And its future development is also unclear. https://github.com/pytorch/pytorch/issues/60832

TensorFlow

TensorFlow, developed by Google, and PyTorch, developed by Facebook, are two of the most popular frameworks for building and training complex machine learning models. TensorFlow is known for its flexibility and robust scalability, making it suitable for both research prototypes and production deployments. PyTorch is praised for its ease of use, simplicity, and dynamic computational graph that allows for more intuitive coding of complex AI models. Both frameworks support a wide range of AI models, from simple linear regression to complex deep neural networks.

> does PyTorch have a similar concept

of course https://github.com/pytorch/pytorch/blob/main/torch/utils/_py...

fyi should work on most 40xx[1]

[1] https://github.com/pytorch/pytorch/issues/119638#issuecommen...

Sure, right here: https://github.com/pytorch/pytorch/blob/main/torch/autograd/...

Here's the documentation: https://pytorch.org/tutorials/intermediate/forward_ad_usage....

> When an input, which we call “primal”, is associated with a “direction” tensor, which we call “tangent”, the resultant new tensor object is called a “dual tensor” for its connection to dual numbers[0].

*My post explains Dot, Matrix and Element-wise multiplication in PyTorch.

In PyTorch with @, dot() or matmul():