LLamaSharp

A C#/.NET library to run LLM models (🦙LLaMA/LLaVA) on your local device efficiently. (by SciSharp)

LLamaSharp Alternatives

Similar projects and alternatives to LLamaSharp

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better LLamaSharp alternative or higher similarity.

LLamaSharp reviews and mentions

Posts with mentions or reviews of LLamaSharp. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-14.
  • This is getting really complicated.
    10 projects | /r/LocalLLaMA | 14 Jun 2023
    For example, I have my own task and I need another tool, so I search and find what I need. https://github.com/SciSharp/LLamaSharp and this allows me to take the next step https://github.com/Xsanf/LLaMa_Unity . I can already run LLM on Unity. And this is already an opportunity to use it in games natively.
  • cannot for the life of me compile libllama.dll
    1 project | /r/LocalLLaMA | 22 May 2023
    I searched through GitHub and nothing comes up that is new. I wanted to run the model through the C# wrapper linked on LLaMASharp which requires compiling llama.cpp and extracting the libllama dll into the C# project files. When I build llama.cpp with OpenBLAS, everything shows up fine in the command line. Just as the link suggests I make sure to set DBUILD_SHARED_LIBS=ON when in CMake. However, the output in the Visual Studio Developer Command Line interface ignores the setup for libllama.dll in the CMakeFiles.txt entirely. The only dll to compile is llama.dll; I know this is a fairly technical question but does anyone know how to fix?
  • Could I get a suggestion for a simple HTTP API with no GUI for llama.cpp?
    8 projects | /r/LocalLLaMA | 16 May 2023
    C#/.NET: SciSharp/LLamaSharp
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 3 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Stats

Basic LLamaSharp repo stats
3
1,917
9.8
3 days ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com