llama-node VS llama.cpp-dotnet

Compare llama-node vs llama.cpp-dotnet and see what are their differences.

llama-node

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model. (by Atome-FE)

llama.cpp-dotnet

Minimal C# bindings for llama.cpp + .NET core library with API host/client. (by dranger003)
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
llama-node llama.cpp-dotnet
2 1
849 54
0.9% -
8.6 9.4
10 months ago 3 days ago
Rust C#
Apache License 2.0 MIT License
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

llama-node

Posts with mentions or reviews of llama-node. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-07-15.
  • Tell HN: Rust Is the Superglue
    3 projects | news.ycombinator.com | 15 Jul 2023
    You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.

    For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.

    They can help you leverage your Rust for writing cool new stuff.

  • Could I get a suggestion for a simple HTTP API with no GUI for llama.cpp?
    8 projects | /r/LocalLLaMA | 16 May 2023
    Node.js: hlhr202/llama-node

llama.cpp-dotnet

Posts with mentions or reviews of llama.cpp-dotnet. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-05-16.

What are some alternatives?

When comparing llama-node and llama.cpp-dotnet you can also consider the following projects:

ChainFury - 🦋 Production grade chaining engine behind TuneChat. Self host today!

LLamaSharp - A C#/.NET library to run LLM models (🦙LLaMA/LLaVA) on your local device efficiently.

text-embeddings-inference - A blazing fast inference solution for text embeddings models

go-llama.cpp - LLama.cpp golang bindings

llama_cpp.rb - llama_cpp provides Ruby bindings for llama.cpp

langchain-ask-pdf-local - An AI-app that allows you to upload a PDF and ask questions about it. It uses StableVicuna 13B and runs locally.

LocalAI - :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

llama-cpp.el - A client for llama-cpp server

llama-cpp-python - Python bindings for llama.cpp

gpt4all.unity - Bindings of gpt4all language models for Unity3d running on your local machine

FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.