Optimum Intel OpenVino Performance

• llama2.openvino

  3 43 7.9 Python

  This sample shows how to implement a llama-based model with OpenVINO runtime

Code adapted from https://github.com/OpenVINO-dev-contest/llama2.openvino

• openvino_notebooks

  79 1,957 9.9 Jupyter Notebook

  📚 Jupyter notebook tutorials for OpenVINO™

  

Also, credits for using zram in your VM setup; that's a smart hack for memory management. Have you tried tweaking other models like the ones in this OpenVINO notebook?

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project