llama2-high-level-cpp
Inference Llama2 with High-Level C++. (by frost-beta)
ollama
Get up and running with Llama 2, Mistral, Gemma, and other large language models. [Moved to: https://github.com/ollama/ollama] (by jmorganca)
| llama2-high-level-cpp | ollama | |
|---|---|---|
| 1 | 1 | |
| 7 | 46,373 | |
| - | - | |
| 3.8 | - | |
| 3 months ago | 2 months ago | |
| C | Go | |
| MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama2-high-level-cpp
Posts with mentions or reviews of llama2-high-level-cpp.
We have used some of these posts to build our list of alternatives
and similar projects.
ollama
Posts with mentions or reviews of ollama.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-03-11.
-
LLMs on your local Computer (Part 1)
ollama.ai
What are some alternatives?
When comparing llama2-high-level-cpp and ollama you can also consider the following projects:
PowerInfer - High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
lit-llama - Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
llama-nuts-and-bolts - A holistic way of understanding how LLaMA and its components run in practice, with code and detailed documentation.
hit-and-blow-solver - 💎Hit & Blow Command Line Solver wrigtten in Go💎