Web LLM – WebGPU Powered Inference of Large Language Models

• web-llm

  43 9,300 9.1 TypeScript

  Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.

  

• ExpansionCards

  1,136 775 4.6 OpenSCAD

  Reference designs and documentation to create Expansion Cards for the Framework Laptop

  

You can get it for a lot less from https://frame.work

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• FastChat

  83 34,277 9.6 Python

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  

No.

Most people are distributing diff files like this https://github.com/lm-sys/FastChat#vicuna-weights

Ie. Here’s a diff. Go find your own copy of the llama model and apply this patch.

Distribution of the actual model (eg. Running it in your browser) seems to usually result in “and then Meta slaps you with a takedown notice”.

• llama

  184 53,227 8.1 Python

  Inference code for Llama models

  

What do you mean, it's not clear?

https://github.com/facebookresearch/llama links to

https://forms.gle/jk851eBVbX1m5TAv5 which contains LLaMA license agreement below the form.

• ml-ane-transformers

  22 2,461 0.0 Python

  Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)

  

Have you seen this?

https://github.com/apple/ml-ane-transformers

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project