llama2-high-level-cpp
Inference Llama2 with High-Level C++. (by frost-beta)
speculative_decoding.c
minimal C implementation of speculative decoding based on llama2.c (by mscheong01)
| llama2-high-level-cpp | speculative_decoding.c | |
|---|---|---|
| 1 | 1 | |
| 7 | 12 | |
| - | - | |
| 3.8 | 4.7 | |
| 3 months ago | 24 days ago | |
| C | C | |
| MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama2-high-level-cpp
Posts with mentions or reviews of llama2-high-level-cpp.
We have used some of these posts to build our list of alternatives
and similar projects.
speculative_decoding.c
Posts with mentions or reviews of speculative_decoding.c.
We have used some of these posts to build our list of alternatives
and similar projects.
What are some alternatives?
When comparing llama2-high-level-cpp and speculative_decoding.c you can also consider the following projects:
PowerInfer - High-speed Large Language Model Serving on PCs with Consumer-grade GPUs