SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 TypeScript llmops Projects
-
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
Project mention: How to change an LLM prompt in production without a code deploy | dev.to | 2026-08-30Langfuse is the other serious option in this category if you also want observability, evals and traces bundled with prompt management. Different scope, more setup, worth comparing honestly.
-
Kargo
Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.
-
composio
Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
Composio provides managed authentication, per-user sessions, MCP access, SDKs, and a large catalog of pre-built tools. It is best suited for individual workflows and prototype agent builds where speed of setup matters more than centralized enterprise governance.
-
promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Primary references: GitHub Spec Kit, Promptfoo assertions, Qwen Code, Goose, Chrome DevTools MCP, MarkItDown MCP, Renovate, and Semgrep CLI.
-
gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Project mention: gateway VS bifrost - a user suggested alternative | libhunt.com/r/gateway | 2026-05-26 -
helicone
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
Gateway or proxy attribution. A reverse proxy in front of the model-provider API records the request, computes the cost, and exposes per-customer breakdowns. Open-source options include Helicone, LiteLLM, Langfuse, and OpenLLMetry. Hosted equivalents serve as the AI cost observability layer for teams that want centralized visibility: LangSmith, Datadog LLM Observability, Arize Phoenix. Adds a network hop. Centralizes instrumentation across a fleet of services.
-
-
pezzo
🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
Project mention: pezzo VS promplify-web - a user suggested alternative | libhunt.com/r/pezzo | 2026-09-02 -
AppSignal
AppSignal knows why the f*#k it crashed. Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.
-
Project mention: Open-source Langsmith alternative written in Rust | news.ycombinator.com | 2026-01-06
-
-
Project mention: Building Your Own AI Proxy: Route, Cache, and Monitor LLM Requests in TypeScript | dev.to | 2026-04-06
For many teams, especially those starting out or with simpler needs, commercial solutions like Portkey, Helicone, OpenPipe, or LiteLLM Proxy offer off-the-shelf capabilities that cover many common proxy use cases (caching, logging, cost tracking). NeuroLink itself can be seen as an SDK that complements these, allowing you to integrate with them or build similar features on top.
-
openlit
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.
-
Project mention: Sovereign MCP: Expose Local MCP Servers to Remote Clients via Cloudflare Tunnel | dev.to | 2025-11-22
View on GitHub
-
langtrace
Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊
-
gateway
The only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs. (by adaline)
-
GPTRouter
Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.
-
openllmetry-js
Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
-
craftgen
Integrating AI into every workflow with our open-source, no-code platform, powered by the actor model for dynamic, graph-based solutions.
-
-
empirical
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application (by empirical-run)
-
inferock-bench
Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.
Project mention: Show HN: Inferock-bench – per-call billing receipts for OpenAI and Anthropic | news.ycombinator.com | 2026-07-10 -
-
-
Nora
Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP. (by solomon2773)
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
TypeScript llmops discussion
TypeScript llmops related posts
-
How to change an LLM prompt in production without a code deploy
-
Should Your Prompt Store Pick Your Model
-
The Observability Crisis: Why OTel Alone Fails for AI and How to Build a Resilient Pipeline
-
Show HN: Budget Guard – a hard daily cap for your OpenAI/Anthropic bill
-
Your AI Agent Works in Dev. It Will Fail in Production. Here's the Math.
-
Every Check Said Our GA4 Analytics Worked. It Had Never Recorded a Visit
-
How to put a hard daily cap on your LangChain.js API costs
-
A note from our sponsor - SaaSHub
www.saashub.com | 8 Sep 2026
Index
What are some of the best open-source llmops projects in TypeScript? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | langfuse | 34,207 |
| 2 | composio | 30,019 |
| 3 | promptfoo | 24,844 |
| 4 | gateway | 12,901 |
| 5 | helicone | 6,130 |
| 6 | langwatch | 3,523 |
| 7 | pezzo | 3,270 |
| 8 | lmnr | 3,227 |
| 9 | ChainForge | 3,025 |
| 10 | OpenPipe | 2,827 |
| 11 | openlit | 2,738 |
| 12 | mcp-router | 2,138 |
| 13 | langtrace | 1,229 |
| 14 | gateway | 605 |
| 15 | GPTRouter | 454 |
| 16 | openllmetry-js | 411 |
| 17 | craftgen | 316 |
| 18 | LangGraph-GUI | 266 |
| 19 | empirical | 166 |
| 20 | inferock-bench | 140 |
| 21 | juror | 122 |
| 22 | sugarcane-ai | 52 |
| 23 | Nora | 50 |
Sponsored
Stop Scripting Promotions. Start Shipping with Kargo
Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.
akuity.io