AI Inference now available in Supabase Edge Functions

• ort

  7 555 9.3 Rust

  A Rust wrapper for ONNX Runtime (by pykeio)

  

To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:

• onnxruntime

  54 12,656 10.0 C++

  ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

  

Embedding generation uses the ONNX runtime under the hood. This is a cross-platform inferencing library that supports multiple execution providers from CPU to specialized GPUs.

• SurveyJS

  surveyjs.io sponsored

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

• supabase

  767 65,869 10.0 TypeScript

  The open source Firebase alternative.

  

Semantic search demo

• ollama

  195 58,943 9.9 Go

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

LLM models are challenging to run directly via ONNX runtime on CPU. For these, we are using a GPU-accelerated Ollama server under the hood:

Suggest a related project