chatty-llama
llm-chain
| chatty-llama | llm-chain | |
|---|---|---|
| 1 | 3 | |
| 27 | 1,184 | |
| - | 5.7% | |
| 7.2 | 8.6 | |
| 8 months ago | 19 days ago | |
| Rust | Rust | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
chatty-llama
-
Chatty LLama: A fullstack Rust + react chat app using Meta's Llama-2 LLMs https://github.com/Sollimann/chatty-llama
Link to repo: https://github.com/Sollimann/chatty-llama FYI, I'm using Rust for model hosting and inference, React for chat app and Caddy as web server. Inference currently runs purely on CPU, but with the option of running on GPU.
llm-chain
What are some alternatives?
floneum - A toolkit for controllable, private AI on consumer hardware in rust
llama-node - Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
tenere - 🔥 TUI interface for LLMs written in Rust
PrivateGPT4Linux - This shell script installs an upgraded GUI version of privateGPT for Linux.
fullstack-rust - Reference implementation of a full-stack Rust application
libopenai - A Rust client for OpenAI's API
smartgpt - A program that provides LLMs with the ability to complete complex tasks using plugins.
openai-client - OpenAI Dive is an unofficial async Rust library that allows you to interact with the OpenAI API.
memex - Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
opentau - Using Large Language Models for Gradual Type Inference
async-openai - Rust library for OpenAI
gpt-cli - Chat GPT Cli that allows you to call the API directly from your terminal