TypeScript Inference

Open-source TypeScript projects categorized as Inference
Edit details
LLM TypeScript AI Machine Learning Webgpu
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 15 TypeScript Inference Projects

TypeScript logo
Inference

  1. ts-pattern

    🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.

    Project mention: Why I built ts-match: TypeScript branching in the era of coding agents | dev.to | 2026-05-12

    I want to be very clear about this: ts-pattern deserves a lot of credit.

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. io-ts

    Runtime type system for IO decoding/encoding

  4. huggingface.js

    Use Hugging Face with JavaScript

    Project mention: Integration with Hugging Face Inference API | dev.to | 2026-06-01

    Hugging Face hosts thousands of open models for NLP, vision, and other tasks. The Inference API (via Inference Providers) lets you call those models over HTTP. The @huggingface/inference package from huggingface.js is the Node.js client.

  5. llmgateway

    Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

    Project mention: LiteLLM Python package compromised by supply-chain attack | news.ycombinator.com | 2026-03-24

    Checkout LLM Gateway: https://llmgateway.io

    Migration guide: https://llmgateway.io/migration/litellm

  6. geti

    Build computer vision models in a fraction of the time and with less data.

  7. typeschema

    🛵 Universal adapter for TypeScript schema validation.

  8. tiny-schema-validator

    JSON schema validator

  9. wingman

    Wingman is the fastest and easiest way to run Llama models on your PC or Mac. (by curtisgray)

  10. antseed

    AntSeed P2P AI Network - An open market for AI inference. No gatekeepers.

  11. 0xBitNet

    Run BitNet b1.58 ternary LLMs with WebGPU — in browsers and native apps

    Project mention: 0xBitNet | news.ycombinator.com | 2026-05-06

  12. Experiment

    🔬 Experiment is an experiment is an experiment is an experiment is an experiment is an e̴x̷p̶e̶r̶i̶m̸e̸n̸t̴ ̷i̵s̴ ̷a̵n̷ è̷̜x̴̝͝p̵̨̐e̴̯̐r̴͔̍ì̸̻m̴̛͎e̵̥̔n̶̠̎t̷̠͝ ̶̼̳̕ǐ̷̞͍͂s̷͍̈́ ̶̫̀a̵̠͌n̵̲͊ ̶̣̼̆ḛ̸̀x̵̰͋p̵͉̺̎e̶̛͈̮ř̸̜̜̅ì̵̜̠͗ṃ̴̼͆ė̴̮n̶̪̈́t̸̢͖͋͂ (by experimental-setup)

  13. kandle

    A JavaScript Native PyTorch-aligned Machine Learning Framework, built from scratch on WebGPU (by final-kk)

    Project mention: Show HN: Kandle – A WebGPU-based ML library written from scratch in JavaScript | news.ycombinator.com | 2026-01-29

  14. accel-gpu

    NumPy for the browser GPU — zero shaders, zero dependencies

    Project mention: Show HN: Accel-GPU v1.0 – NumPy for browser GPU | news.ycombinator.com | 2026-03-04

    • Vector Search: https://phantasm0009.github.io/accel-gpu/example/vector-sear...

  15. SLMGen

    Fine-tune small language models the right way — dataset intelligence, explainable model selection, and production-ready Colab notebooks.

    Project mention: I Built an Automated SLM Fine-Tuning Engine with Python and Unsloth 🚀 | dev.to | 2026-01-19

    I wanted to fix that friction. So I built SLMGen, an open-source tool that automates the entire process.

  16. t4t

    Decentralized AI inference marketplace

    Project mention: Decentralized AI Inference Marketplace | news.ycombinator.com | 2026-06-09

    Run the gateway container, point any OpenAI-compatible app (OpenWebUI, LibreChat, Continue.dev, your own SDK) at localhost:3000/v1. Pay per token to whichever provider the market picks for you.

    repo: https://github.com/ffaerber/t4t

    i also created a hosted gateway: https://t4t-gateway.com

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

TypeScript Inference discussion

Log in or Post with

TypeScript Inference related posts

Index

What are some of the best open-source Inference projects in TypeScript? This list will help you:

# Project Stars
1 ts-pattern 15,032
2 io-ts 6,814
3 huggingface.js 2,435
4 llmgateway 1,288
5 geti 484
6 typeschema 456
7 tiny-schema-validator 181
8 wingman 45
9 antseed 20
10 0xBitNet 16
11 Experiment 11
12 kandle 7
13 accel-gpu 5
14 SLMGen 1
15 t4t 0

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Loading...