Releasing local.ai - an LLM local playground with minimal setup

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Our great sponsors
  • SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • local.ai

    🎒 local.ai - Run AI locally on your PC!

  • I wanted to publish it back in mid April but had to went through a bunch of hoop to acquire the signing certs to sign the Windows and Mac binary. Now that I got all of the certs in place, the app is now signed and has auto-update capability! (OV cert only tho, so Windows would still show a yellow warning....) Demo/download: https://www.localai.app/ Source code: https://github.com/louisgv/local.ai

  • llama.cpp

    LLM inference in C/C++

  • Convert pytorch-based models to work with llama.cpp? · Issue #707 · ggerganov/llama.cpp (github.com)

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
  • LocalAI

    :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  • Great project, but there is already a project called LocalAI, so maybe a name change?

  • window.ai

    Use your own AI models on the web

  • You can actually try out a version of your idea with the sample chat app on windowai.io (will need to grab the extension, the app and the extension work together). In `window.ai` extension, you will want to set the model as `local`, and all call will be routed to `local.ai` for inferencing! <- This enables user of window to test out AI app without incurring any cloud cost :D

  • pnpm

    Fast, disk space efficient package manager

  • What version of pnpm are you using? I found this issue, maybe it's related?

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts