llama.net
.NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. 🦙 (by hpretila)
LLamaSharp
A C#/.NET library to run LLM models (🦙LLaMA/LLaVA) on your local device efficiently. (by SciSharp)
llama.net | LLamaSharp | |
---|---|---|
2 | 3 | |
53 | 2,043 | |
- | 15.2% | |
4.0 | 9.8 | |
about 1 year ago | 3 days ago | |
C# | C# | |
MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama.net
Posts with mentions or reviews of llama.net.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-02.
-
Is there an api for hugging face LLMs
Build one on dotnet with llama.cpp and https://github.com/hpretila/llama.net
- api supported local llm
LLamaSharp
Posts with mentions or reviews of LLamaSharp.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-14.
-
This is getting really complicated.
For example, I have my own task and I need another tool, so I search and find what I need. https://github.com/SciSharp/LLamaSharp and this allows me to take the next step https://github.com/Xsanf/LLaMa_Unity . I can already run LLM on Unity. And this is already an opportunity to use it in games natively.
-
cannot for the life of me compile libllama.dll
I searched through GitHub and nothing comes up that is new. I wanted to run the model through the C# wrapper linked on LLaMASharp which requires compiling llama.cpp and extracting the libllama dll into the C# project files. When I build llama.cpp with OpenBLAS, everything shows up fine in the command line. Just as the link suggests I make sure to set DBUILD_SHARED_LIBS=ON when in CMake. However, the output in the Visual Studio Developer Command Line interface ignores the setup for libllama.dll in the CMakeFiles.txt entirely. The only dll to compile is llama.dll; I know this is a fairly technical question but does anyone know how to fix?
-
Could I get a suggestion for a simple HTTP API with no GUI for llama.cpp?
C#/.NET: SciSharp/LLamaSharp
What are some alternatives?
When comparing llama.net and LLamaSharp you can also consider the following projects:
uCat - Hi!👋😸I am uCat, your brain implant assistant. I can help you speak and move again; inside the metaverse.
SillyTavern - LLM Frontend for Power Users.