Accelerated PyTorch Training on M1 Mac

• tensorexperiments

  1 36 0.0 Python

  Boilerplate for GPU-Accelerated TensorFlow and PyTorch code on M1 Macbook

Since it's tangentially relevant, if you have an M1 Mac I've created [some boilerplate](https://github.com/alexfromapex/tensorexperiments) for working with the latest Tensorflow with GPU acceleration as well.

• neural-engine

  21 1,884 5.1

  Everything we actually know about the Apple Neural Engine (ANE)

> Is too limited? Too hard to interact with? Not worth the effort?

IIRC the only way to access ANE is through the Accelerate framework, and it seems to have pretty severe limitations[0].

Apple has developed a tensorflow plugin[1] but i can't tell you if it uses ANE. Earlier this year they also published a job offer talking about accelerating PyTorch with BNNS and Accelerate[2]. Apparently PyTorch already uses Accelerate and AMX (the matrix coprocessor).

So might indeed be that ANE is too limited and Accelerate never gets to use it.

[0] https://github.com/hollance/neural-engine

[1] https://developer.apple.com/metal/tensorflow-plugin/

[2] https://github.com/pytorch/pytorch/issues/47702#issuecomment...

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Pytorch

  341 78,205 10.0 Python

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  

> Is too limited? Too hard to interact with? Not worth the effort?

IIRC the only way to access ANE is through the Accelerate framework, and it seems to have pretty severe limitations[0].

Apple has developed a tensorflow plugin[1] but i can't tell you if it uses ANE. Earlier this year they also published a job offer talking about accelerating PyTorch with BNNS and Accelerate[2]. Apparently PyTorch already uses Accelerate and AMX (the matrix coprocessor).

So might indeed be that ANE is too limited and Accelerate never gets to use it.

[0] https://github.com/hollance/neural-engine

[1] https://developer.apple.com/metal/tensorflow-plugin/

[2] https://github.com/pytorch/pytorch/issues/47702#issuecomment...

• cnn-benchmarks

  1 2,517 10.0 Python

  Benchmarks for popular CNN models

> ResNet > VGG: ResNet-50 is faster than VGG-16 and more accurate than VGG-19 (7.02 vs 9.0); ResNet-101 is about the same speed as VGG-19 but much more accurate than VGG-16 (6.21 vs 9.0).

https://github.com/jcjohnson/cnn-benchmarks#:~:text=ResNet%2....

• pytorch-apple-silicon-benchmarks

  1 35 3.7 Jupyter Notebook

  Performance of PyTorch on Apple Silicon

I started collecting benchmarks of the M1 Max on PyTorch here: https://github.com/lucadiliello/pytorch-apple-silicon-benchm...

• pytorch-apple-silicon-benchm

  1 - -

I started collecting benchmarks of the M1 Max on PyTorch here: https://github.com/lucadiliello/pytorch-apple-silicon-benchm...

Suggest a related project