[D] What Repos/Tools Should We Pay Attention To?

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

Right now https://github.com/ggerganov/llama.cpp is the dominant back-end for querying models, but forks and alternatives like https://github.com/ravenscroftj/turbopilot keep popping up. Increasingly, models submitted to huggingface explicitly note in their READMEs that the model is not compatible with llama.cpp, and that a different back-end must be used.

• turbopilot

  15 3,839 10.0 C++

  Discontinued Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

Right now https://github.com/ggerganov/llama.cpp is the dominant back-end for querying models, but forks and alternatives like https://github.com/ravenscroftj/turbopilot keep popping up. Increasingly, models submitted to huggingface explicitly note in their READMEs that the model is not compatible with llama.cpp, and that a different back-end must be used.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• ggml

  69 9,642 9.8 C

  Tensor library for machine learning

The related https://github.com/ggerganov/ggml project (same dev as llama.cpp),

• nanoGPT

  69 31,713 5.4 Python

  The simplest, fastest repository for training/finetuning medium-sized GPTs.

The excellent https://github.com/karpathy/nanoGPT project, for training your own models,

Suggest a related project