Running Mistral LLM on Apple Silicon Using Apple's MLX Framework Is Much Faster

• mlx-examples

  29 4,918 9.7 Python

  Examples in the MLX framework

  

• llama-cpp-python

  54 6,378 9.9 Python

  Python bindings for llama.cpp

If the model could be made to work with llama.cpp, then https://github.com/abetlen/llama-cpp-python might be more compact. llama.cpp only supports a limited list of model types though.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project