Self train a super tiny model recommendations

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

Llama.cpp has a train text from scratch example that you can run through CPU, RAM and offloading to GPU, although I'd imagine it'd be much less performant than a pure GPU solution.

• transformers

  175 125,021 10.0 Python

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

You can train it with the code provided in transformer repo: https://github.com/huggingface/transformers/blob/main/examples/pytorch/language-modeling/run_clm.py

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• ml-engineering

  9 9,753 9.7 Python

  Machine Learning Engineering Open Book

this might be interesting: https://github.com/stas00/ml-engineering/blob/master/transformers/make-tiny-models.md

Suggest a related project