fastLLaMa

fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backend. (by PotatoSpudowski)

fastLLaMa Alternatives

Similar projects and alternatives to fastLLaMa

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better fastLLaMa alternative or higher similarity.

fastLLaMa reviews and mentions

Posts with mentions or reviews of fastLLaMa. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-05-03.

Stats

Basic fastLLaMa repo stats
6
403
7.1
11 months ago

PotatoSpudowski/fastLLaMa is an open source project licensed under MIT License which is an OSI approved license.

fastLLaMa is marked as "self-hosted". This means that it can be used as a standalone application on its own.

The primary programming language of fastLLaMa is C.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com