Executorch Alternatives

ollama

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.

whisper.cpp

Port of OpenAI's Whisper model in C/C++

llama

Inference code for Llama models

mlx

MLX: An array framework for Apple silicon

candle

Minimalist ML framework for Rust

ml-ane-transformers

Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)

coremltools

Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.

torchchat

Run PyTorch LLMs locally on servers, desktop and mobile

MegEngine

MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架

dfdx

Deep learning in Rust, with shape checked tensors and neural networks

DALI

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

Pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Anemll

Artificial Neural Engine Machine Learning Library

ane

Reverse engineered Linux driver for the Apple Neural Engine (ANE).

Daisykit

Daisykit is an easy AI toolkit with face mask detection, pose detection, background matting, barcode detection, and more. With Daisykit, you don't need AI knowledge to build AI software.

ml-vision-transformers-ane

norse

Deep learning with spiking neural networks (SNNs) in PyTorch.