speculative_decoding.c
minimal C implementation of speculative decoding based on llama2.c (by mscheong01)
llama2-high-level-cpp
Inference Llama2 with High-Level C++. (by frost-beta)
| speculative_decoding.c | llama2-high-level-cpp | |
|---|---|---|
| 1 | 1 | |
| 13 | 7 | |
| - | - | |
| 4.7 | 3.8 | |
| about 1 month ago | 3 months ago | |
| C | C | |
| MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
speculative_decoding.c
Posts with mentions or reviews of speculative_decoding.c.
We have used some of these posts to build our list of alternatives
and similar projects.
llama2-high-level-cpp
Posts with mentions or reviews of llama2-high-level-cpp.
We have used some of these posts to build our list of alternatives
and similar projects.
What are some alternatives?
When comparing speculative_decoding.c and llama2-high-level-cpp you can also consider the following projects:
PowerInfer - High-speed Large Language Model Serving on PCs with Consumer-grade GPUs