Meta's Segment Anything written with C++ / GGML

• sam.cpp

  2 1,224 7.6 C++

• bark.cpp

  4 513 8.1 C++

  Port of Suno AI's Bark in C/C++ for fast inference

Another GGML model port that I'm pretty excited about is https://github.com/PABannier/bark.cpp.

The Bark python model is very compute intensive and require a powerful GPU to get bearable inference speed. I really hope that bark.cpp with GPU/Metal support and quanticized model can bring useful inference speed on a laptop in the near future.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• Queryable

  5 2,424 7.9 Swift

  Run OpenAI's CLIP model on iOS to search photos.

I think you would want to use something like CLIP embeddings for image search.

Really enjoyed using this app for iOS: https://github.com/mazzzystar/Queryable

• llm

  41 5,885 9.4 Rust

  An ecosystem of Rust libraries for working with large language models

  

> Tensorflow is a C++ framework that has Python bindings and a Python library, but when the models are served they are running on C++

Sure, and it's only a simple 20 step process that involves building Tensorflow from source. Yeay!

https://medium.com/@hamedmp/exporting-trained-tensorflow-mod...

Let me see what the process for compiling a LLM written in Rust is....

https://github.com/rustformers/llm

    cargo install llm-cli

Suggest a related project