llama-node
llama-cpp.el
llama-node | llama-cpp.el | |
---|---|---|
2 | 1 | |
849 | 19 | |
0.9% | - | |
8.6 | 7.2 | |
10 months ago | 4 days ago | |
Rust | Emacs Lisp | |
Apache License 2.0 | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama-node
-
Tell HN: Rust Is the Superglue
You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.
For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.
They can help you leverage your Rust for writing cool new stuff.
-
Could I get a suggestion for a simple HTTP API with no GUI for llama.cpp?
Node.js: hlhr202/llama-node
llama-cpp.el
What are some alternatives?
ChainFury - 🦋 Production grade chaining engine behind TuneChat. Self host today!
humanscript - A truly natural scripting language
text-embeddings-inference - A blazing fast inference solution for text embeddings models
PerroPastor - Run Llama based LLMs in Unity entirely in compute shaders with no dependencies
LLamaSharp - A C#/.NET library to run LLM models (🦙LLaMA/LLaVA) on your local device efficiently.
llama_cpp.rb - llama_cpp provides Ruby bindings for llama.cpp
langchain-ask-pdf-local - An AI-app that allows you to upload a PDF and ask questions about it. It uses StableVicuna 13B and runs locally.
llamero - A GUI application to easily try out Facebook's LLaMA models.
gpt4all.unity - Bindings of gpt4all language models for Unity3d running on your local machine
dalai - The simplest way to run LLaMA on your local machine
langtorch - 🔥 Building composable LLM applications & workflow with Java.
MiniGPT-4-discord-bot - A true multimodal LLaMA derivative -- on Discord!