Gpt-fast Alternatives

Similar projects and alternatives to gpt-fast

• unsloth

  15 7,263 9.4 Python gpt-fast VS unsloth

  Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

  

• TensorRT-LLM

  13 6,556 8.4 C++ gpt-fast VS TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• stable-fast

  11 960 9.5 Python gpt-fast VS stable-fast

  Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

• hyperlearn

  4 1,578 0.0 Jupyter Notebook gpt-fast VS hyperlearn

  2-2000x faster ML algos, 50% less memory usage, works on all hardware - new and old.

  

• optimum-nvidia

  1 771 9.3 Python gpt-fast VS optimum-nvidia
  

• segment-anything-fast

  1 1,113 7.2 Python gpt-fast VS segment-anything-fast

  A batched offline inference oriented version of segment-anything