text-embeddings-inference
frugal
text-embeddings-inference | frugal | |
---|---|---|
3 | 1 | |
2,073 | 18 | |
10.6% | - | |
8.9 | 7.9 | |
4 days ago | 8 months ago | |
Rust | JavaScript | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
text-embeddings-inference
-
HuggingFace text-generation-inference is reverting to Apache 2.0 License
Worth noting that this also impacts the great https://github.com/huggingface/text-embeddings-inference, which allows anyone to run state of the art embeddings with great performance.
- FLaNK Stack Weekly for 30 Oct 2023
- Fast inference for text models using Rust
frugal
What are some alternatives?
llama-node - Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
llm.report - 📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.
smartgpt - A program that provides LLMs with the ability to complete complex tasks using plugins.
ChatGPT Widescreen - 🖥️ Adds Widescreen + Fullscreen modes to ChatGPT for enhanced viewing
auto-rust - auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing procedural macros.
DuckDuckGPT - 🐤 DuckDuckGo add-on that brings the magic of ChatGPT to search results (powered by GPT-4!)
floneum - A toolkit for controllable, private AI on consumer hardware in rust
ChatGPT Auto Refresh - ↻ Keeps ChatGPT sessions fresh to avoid network errors + Cloudflare checks
openv0 - AI generated UI components
CSGHub - CSGHub is an opensource large model assets platform just like on-premise huggingface which helps to manage datasets, model files, codes and more. CSGHub是一个开源、可信的大模型资产管理平台,可帮助用户治理LLM和LLM应用生命周期中涉及到的资产(数据集、模型文件、代码等)。CSGHub提供类似私有化的Huggingface功能,以类似OpenStack Glance管理虚拟机镜像、Harbor管理容器镜像以及Sonatype Nexus管理制品的方式,实现对LLM资产的管理。欢迎关注反馈和Star⭐️
Autoclear ChatGPT History - 🕶️ Adds chat auto-clear functionality to ChatGPT for more privacy