Inference Alternatives

Similar projects and alternatives to inference

• OpenAI-DotNet

  32 582 7.7 C# inference VS OpenAI-DotNet

  A Non-Official OpenAI RESTful API Client for DotNet

  

• greptimedb

  16 3,781 9.9 Rust inference VS greptimedb

  An open-source, cloud-native, distributed time-series database with PromQL/SQL/Python supported. Available on GreptimeCloud.

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• dify

  13 25,645 9.9 TypeScript inference VS dify

  Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

  

• truss

  3 837 9.6 Python inference VS truss

  The simplest way to serve AI/ML models in production (by basetenlabs)

  

• agentchain

  2 563 5.8 Python inference VS agentchain

  Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks

  

• ChatGLM2-6B

  4 15,514 6.6 Python inference VS ChatGLM2-6B

  ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

  

• h2o-wizardlm

  2 277 7.2 Python inference VS h2o-wizardlm

  Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• mpt-30B-inference

  3 572 6.2 Python inference VS mpt-30B-inference

  Run inference on MPT-30B using CPU

• aihandler

  4 9 9.0 Python inference VS aihandler

  A simple engine to help run diffusers and transformers models

  

• rwkv.cpp

  12 1,102 6.8 C++ inference VS rwkv.cpp

  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

  

• inference-benchmark

  1 26 6.4 Python inference VS inference-benchmark

  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)

  

• bagua

  6 865 4.8 Python inference VS bagua

  Bagua Speeds up PyTorch