Everything we know about the Apple Neural Engine (ANE)

• neural-engine

  20 1,857 5.1

  Everything we actually know about the Apple Neural Engine (ANE)

My question too. This semi-answer on the page seems to contradict itself (source: https://github.com/hollance/neural-engine/blob/master/docs/p... ):

"> Can I program the ANE directly?

Unfortunately not. You can only use the Neural Engine through Core ML at the moment.

There currently is no public framework for programming the ANE. There are several private, undocumented frameworks but obviously we cannot use them as Apple rejects apps that use private frameworks.

(Perhaps in the future Apple will provide a public version of AppleNeuralEngine.framework.)"

The last part links to this bunch of headers:

https://github.com/nst/iOS-Runtime-Headers/tree/master/Priva...

So might it be more accurate to say you can program it directly, but won't end up with something that can be distributed on the app store?

• tinygrad

  58 17,800 9.7 Python

  Discontinued You like pytorch? You like micrograd? You love tinygrad! ❤️ [Moved to: https://github.com/tinygrad/tinygrad] (by geohot)

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• iOS-Runtime-Headers

  2 7,918 10.0 Objective-C

  iOS Objective-C headers as derived from runtime introspection

My question too. This semi-answer on the page seems to contradict itself (source: https://github.com/hollance/neural-engine/blob/master/docs/p... ):

"> Can I program the ANE directly?

Unfortunately not. You can only use the Neural Engine through Core ML at the moment.

There currently is no public framework for programming the ANE. There are several private, undocumented frameworks but obviously we cannot use them as Apple rejects apps that use private frameworks.

(Perhaps in the future Apple will provide a public version of AppleNeuralEngine.framework.)"

The last part links to this bunch of headers:

https://github.com/nst/iOS-Runtime-Headers/tree/master/Priva...

So might it be more accurate to say you can program it directly, but won't end up with something that can be distributed on the app store?

• ane

  1 308 7.2 C

  Reverse engineered Linux driver for the Apple Neural Engine (ANE).

• anecc

  2 45 6.4 Python

  Run a CoreML MLModel on the Asahi Neural Engine

• m1n1

  17 3,362 8.9 Python

  A bootloader and experimentation playground for Apple Silicon

  

• ml-ane-transformers

  22 2,461 0.0 Python

  Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• whisper.cpp

  187 30,942 9.8 C

  Port of OpenAI's Whisper model in C/C++

Suggest a related project