TypeScript llmops

Open-source TypeScript projects categorized as llmops
Edit details
Topics: llm prompt-engineering AI openai open-source
Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.
surveyjs.io
featured

Top 10 TypeScript llmops Projects

  • gateway

    A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

    • Project mention: Adding a streaming run function to the Assistants API | news.ycombinator.com | 2024-02-07

  • OpenPipe

    Turn expensive prompts into cheap fine-tuned models

    • Project mention: Ask HN: How does deploying a fine-tuned model work | news.ycombinator.com | 2024-04-23

    - Fireworks: $0.20

    If you're looking for an end-to-end flow that will help you gather the training data, validate it, run the fine tune and then define evaluations, you could also check out my company, OpenPipe (https://openpipe.ai/). In addition to hosting your model, we help you organize your training data, relabel if necessary, define evaluations on the finished fine-tune, and monitor its performance in production. Our inference prices are higher than the above providers, but once you're happy with your model you can always export your weights and host them on one of the above!

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo

  • rebuff

    LLM Prompt Injection Detector

    • Project mention: Rebuff: Detect and protect against prompt injection attacks in LLMs | news.ycombinator.com | 2023-07-05

  • llm.report

    📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.

    • Project mention: Show HN: Monitoring your OpenAI usage without a third party | news.ycombinator.com | 2023-10-04

  • app

    BitGPT it's your personal AI in your pocket (by bit-gpt)

    • Project mention: Prem – Private Open Source LLMs for All | news.ycombinator.com | 2023-06-20

  • GPTRouter

    Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

    • Project mention: Show HN: GPT Router – Open-Source API Gateway for LLMs (OpenAI, Anthropic, etc.) | news.ycombinator.com | 2023-12-22

  • LLMstudio

    Framework to bring LLM applications to production

    • Project mention: Mixtral: Mixture of Experts | news.ycombinator.com | 2024-01-08

    Lmstudio (that they linked) is definitely not open source, and doesn't even offer a pricing model for business use.

    Llmstudio is, but I suspect that was a typo in their comment. https://github.com/TensorOpsAI/LLMStudio

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • langtrace

    Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

    • Project mention: Pydantic Logfire | news.ycombinator.com | 2024-04-30

    +1 to this. Langtrace core maintainer here. We are building a SDK and a client for automatic instrumentation of LLM based applications using OTEL standards. The OpenLLMetry team along with the CNCF OpenTelemetry working group has been doing some great work standardizing semantic naming conventions and we are starting to adopt the same set of standards.

    [1] https://github.com/Scale3-Labs/langtrace

  • sugarcane-ai

    npm like package ecosystem for Prompts 🤖

    • Project mention: Show HN: Made Open Source NPM like package ecosytem for reusable Prompts | news.ycombinator.com | 2023-12-15

  • openllmetry-js

    Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

    • Project mention: FLaNK Stack Weekly 19 Feb 2024 | dev.to | 2024-02-19
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

TypeScript llmops related posts

  • OpenAI: Improvements to the fine-tuning API and expanding our cus

    1 project | news.ycombinator.com | 4 Apr 2024

  • Doku: Open-source LLM observability platform

    1 project | news.ycombinator.com | 25 Mar 2024

  • Show HN: Open-Source LLM Observability and Export to Grafana, Datadog etc.

    2 projects | news.ycombinator.com | 22 Mar 2024

  • AI Infrastructure Landscape

    6 projects | news.ycombinator.com | 26 Feb 2024

  • Adding a streaming run function to the Assistants API

    1 project | news.ycombinator.com | 7 Feb 2024

  • Launch HN: Talc AI (YC S23) – Test Sets for AI

    1 project | news.ycombinator.com | 18 Jan 2024

  • We open sourced our AI gateway written in TS

    3 projects | dev.to | 9 Jan 2024
  • A note from our sponsor - SurveyJS
    surveyjs.io | 1 May 2024
    With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js. Learn more →

Index

What are some of the best open-source llmops projects in TypeScript? This list will help you:

Project Stars
1 gateway 4,543
2 OpenPipe 2,374
3 rebuff 934
4 llm.report 829
5 app 448
6 GPTRouter 378
7 LLMstudio 206
8 langtrace 65
9 sugarcane-ai 44
10 openllmetry-js 33

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com