llama.cppav
By ggerganov
cog-llama-template
LLaMA Cog template (by replicate)
| llama.cppav | cog-llama-template | |
|---|---|---|
| 1 | 1 | |
| - | 303 | |
| - | 1.7% | |
| - | 9.2 | |
| - | 4 months ago | |
| Python | ||
| - | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama.cppav
Posts with mentions or reviews of llama.cppav.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-18.
-
Llama 2 – Meta AI
I think using this project https://github.com/ggerganov/llama.cppav
on a CPU machine with AVX instructions would be a better bang for your buck than GPU. Depends on if your use case can tolerate the latency
cog-llama-template
Posts with mentions or reviews of cog-llama-template.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-18.
-
Llama 2 – Meta AI
* or even deploy your own LLaMA v2 fine tune with Cog (https://github.com/a16z-infra/cog-llama-template)
Please let us know what you use this for or if you have feedback! And thanks to all contributors to this model, Meta, Replicate, the Open Source community!
What are some alternatives?
When comparing llama.cppav and cog-llama-template you can also consider the following projects:
llama - Inference code for LLaMA models on CPU and Mac M1/M2 GPU
llama2-chatbot - LLaMA v2 Chatbot
marsha - Marsha is a functional, higher-level, English-based programming language that gets compiled into tested Python software by an LLM
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
OpenPipe - Turn expensive prompts into cheap fine-tuned models