Isartor Alternatives
Similar projects and alternatives to Isartor
-
ai-firewall
OpenAI-compatible LLM gateway that reduces API costs using Redis exact cache and Qdrant semantic cache.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
liter-llm
Universal LLM API client — 163 providers, 14 native language bindings, powered by a Rust core
-
splintr
A high-performance tokenizer (BPE, WordPiece, SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.
-
tensorzero
Discontinued TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
-
-
fireside-chat
An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasm) frontend packaged with Tauri!
-
cai
User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results! (by ad-si)
-
rllm
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating. (by graniet)
-
-
Isartor discussion
Isartor reviews and mentions
-
Isartor – Pure-Rust prompt firewall, deflects 60-95% of LLM traffic
one I forgot, please visit the benchmark of Isartor and see the deflection rate to reduce LLM tokens: https://github.com/isartor-ai/Isartor/tree/main/benchmarks
Stats
isartor-ai/Isartor is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of Isartor is Rust.