Show HN: I built a free in-browser Llama 3 chatbot powered by WebGPU

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com
GPU Deep Learning tvm ScreenShot Compiler

SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.
surveyjs.io
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

  • secret-llama

    Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.

    • I believe it’s only compatible with full Chrome / Edge

    https://github.com/abi/secret-llama?tab=readme-ov-file#syste...

  • web-llm

    Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.

    • Looks like it uses this: https://github.com/mlc-ai/web-llm

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo

  • gpuweb

    Where the GPU for the Web work happens!

    • Works for me.

    WebGPU support is behind a couple flags on Linux: https://github.com/gpuweb/gpuweb/wiki/Implementation-Status

  • flameshot

    Powerful yet simple to use screenshot software :desktop_computer: :camera_flash:

    • I'm using flameshot ( https://flameshot.org/ ), which sounds pretty similar, but FOSS and cross platform.

  • window.ai

    Use your own AI models on the web

    • Window AI (https://windowai.io/) is an attempt to do something like this with a browser extension.

  • tvm

    Open deep learning compiler stack for cpu, gpu and specialized accelerators

    • Yes. Web-llm is a wrapper of tvmjs: https://github.com/apache/tvm

    Just wrappers all the way down

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts