text-embeddings-inference
RustNet
text-embeddings-inference | RustNet | |
---|---|---|
3 | 1 | |
2,055 | 0 | |
9.8% | - | |
8.9 | 7.2 | |
12 days ago | 5 months ago | |
Rust | Rust | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
text-embeddings-inference
-
HuggingFace text-generation-inference is reverting to Apache 2.0 License
Worth noting that this also impacts the great https://github.com/huggingface/text-embeddings-inference, which allows anyone to run state of the art embeddings with great performance.
- FLaNK Stack Weekly for 30 Oct 2023
- Fast inference for text models using Rust
RustNet
What are some alternatives?
llama-node - Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
cudarc - Safe rust wrapper around CUDA toolkit
smartgpt - A program that provides LLMs with the ability to complete complex tasks using plugins.
bws - BWS is a Rust-powered Minecraft server framework, offering unparalleled performance, extendability, and reliability for creating your dream Minecraft experience.
auto-rust - auto-rust is an experimental project that aims to automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing procedural macros.
krust-manifesto - Abstractions to write concise Kubernetes manifests using Rust
floneum - A toolkit for controllable, private AI on consumer hardware in rust
tiny-ml - Basic neural networks for rust
openv0 - AI generated UI components
vault-server - Rust REST API server and white-label SolidJS UIs for semantic search and RAG/no-hallucination LLM-chat [Moved to: https://github.com/arguflow/arguflow]
CSGHub - CSGHub is an opensource large model assets platform just like on-premise huggingface which helps to manage datasets, model files, codes and more. CSGHub是一个开源、可信的大模型资产管理平台,可帮助用户治理LLM和LLM应用生命周期中涉及到的资产(数据集、模型文件、代码等)。CSGHub提供类似私有化的Huggingface功能,以类似OpenStack Glance管理虚拟机镜像、Harbor管理容器镜像以及Sonatype Nexus管理制品的方式,实现对LLM资产的管理。欢迎关注反馈和Star⭐️
duchess - Silky smooth Java-Rust interop