Llama 2 on ONNX runs locally

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

How does this compare to using https://github.com/ggerganov/llama.cpp with https://huggingface.co/models?search=thebloke/llama-2-ggml ?

• Llama-2-Onnx

  3 983 6.7 Python
  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• onnx-coreml

  1 378 10.0 Python

  Discontinued ONNX to Core ML Converter

  

They used to have this: https://github.com/onnx/onnx-coreml

• SHARK

  84 1,382 9.4 Python

  SHARK - High Performance Machine Learning Distribution

  

Suggest a related project