llama-node
langchain-ask-pdf-local
llama-node | langchain-ask-pdf-local | |
---|---|---|
2 | 2 | |
849 | 78 | |
0.9% | - | |
8.6 | 2.1 | |
10 months ago | about 1 year ago | |
Rust | Python | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama-node
-
Tell HN: Rust Is the Superglue
You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.
For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.
They can help you leverage your Rust for writing cool new stuff.
-
Could I get a suggestion for a simple HTTP API with no GUI for llama.cpp?
Node.js: hlhr202/llama-node
langchain-ask-pdf-local
-
Has anyone been able to train their own model on private data?
Now im using this repo https://github.com/wafflecomposite/langchain-ask-pdf-local But with a wrapper to use oobagoba api (so I can benefit from the gpu power)
-
langchain all run locally with gpu using oobabooga
i was doing some testing and manage to use a langchain pdf chat bot with the oobabooga-api, all run locally in my gpu. using this main code langchain-ask-pdf-local with the webui class in oobaboogas-webui-langchain_agent this is the result (100% not my code, i just copy and pasted it) PDFChat_Oobabooga.
What are some alternatives?
ChainFury - 🦋 Production grade chaining engine behind TuneChat. Self host today!
realtime-bakllava - llama.cpp with BakLLaVA model describes what does it see
text-embeddings-inference - A blazing fast inference solution for text embeddings models
LangChain_PDFChat_Oobabooga - oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local
LLamaSharp - A C#/.NET library to run LLM models (🦙LLaMA/LLaVA) on your local device efficiently.
InternChat - InternGPT / InternChat allows you to interact with ChatGPT by clicking, dragging and drawing using a pointing device. [Moved to: https://github.com/OpenGVLab/InternGPT]
llama-cpp.el - A client for llama-cpp server
InternGPT - InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)
gpt4all.unity - Bindings of gpt4all language models for Unity3d running on your local machine
code-llama-for-vscode - Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
langtorch - 🔥 Building composable LLM applications & workflow with Java.
oobaboogas-webui-langchain_agent - Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work