Where can I learn more about SIMD, CPU intrinsics and the like in the context of Rust?

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

I am a machine learning researcher working in NLP, but mostly on the higher level research. I have been tracking the progress of language model implementations on the C++ side lately and have been very impressed with the effort and performance of https://github.com/ggerganov/llama.cpp

• rllama

  7 518 6.2 Rust

  Rust+OpenCL+AVX2 implementation of LLaMA inference code

I have seen some Rust attempts as well such as https://github.com/Noeda/rllama/ but they are still way behind the C++ ones. This seems like an interesting space to get into.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• ultraviolet

  4 727 5.6 Rust

  A wide linear algebra crate for games and graphics.

Some other good places to look would be the source code for the ultraviolet crate and for wide.

Suggest a related project