First steps with llama

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

To do this is I managed to stumble over this project llama.cpp by Georgi Gerganov, which also has a couple of bindings to other programming languages.

• llama-cpp-python

  54 6,378 9.9 Python

  Python bindings for llama.cpp

I went with Python, llama-cpp-python, since my goal is just to get a small project up and running locally.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project