bacalhau
web-llm
Our great sponsors
| bacalhau | web-llm | |
|---|---|---|
| 12 | 42 | |
| 601 | 8,973 | |
| 5.3% | 3.7% | |
| 9.8 | 9.0 | |
| 8 days ago | 10 days ago | |
| Go | TypeScript | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bacalhau
-
Deno Cron
This is really interesting - we’ve tried really hard to solve some of these with Bacalhau[1] - a much simpler distributed compute platform. Would love your feedback!
[1] https://github.com/bacalhau-project/bacalhau
Disclosure: I confounded Bacalhau
-
Building a Distributed Data Warehouse Without Data Lakes
It's an interesting question!
The problem is that the data is spread everywhere - no choice about that. So with that in mind, how do you query that data? Today, the idea is that you HAVE to put it into a central location. With tools like Bacalhau[1] and DuckDB [2], you no longer have to - a single query can be sharded amongst all your data - EFFECTIVELY giving you a lot of what you want from a data lake.
It's not a replacement, but if you can do a few of these items WITHOUT moving the data, you will be able to see really significant cost and time savings.
- Bacalhau: Compute over Data framework for public, transparent, verifiable work
-
Ask HN: What tech is under the radar with all attention on ChatGPT etc.
Very selfishly - distributed compute. Not decentralized, distributed.
Compute and data are being created and run everywhere, we need platforms that understand how to use it and get insights without (or before) moving it.
Our contribution: https://github.com/bacalhau-project/bacalhau (think Kubernetes but built for the distributed world).
Disclosure: I co-founded the Bacalhau Project
- Waterlily.ai Launches to Make AI Art More Accessible and Equitable
-
Building a Distributed World of WebAssembly with Bacalhau
Thank you so much for the feedback. Yeah, we REALLY do want to figure out a better naming/reference scheme. Do you have anything you've seen you really like?
Disclosure: I work on Bacalhau[1]
- What Is Bacalhau?
- GitHub
- The Bacalhau Vision – A Distributed Compute over Data Platform
web-llm
- What stack would you recommend to build a LLM app in React without a backend?
-
When LLM doesn’t fit into memory, how to make it work?
So I was playing with MLC webllm locally. I got my mistral 7B model installed and quantised. Converted it using mlc lib to metal package for Apple chips. Now it takes only 3.5GB of memory
-
Show HN: Ollama for Linux – Run LLMs on Linux with GPU Acceleration
Maybe they're talking about https://github.com/mlc-ai/mlc-llm which is used for web-llm (https://github.com/mlc-ai/web-llm)? Seems to be using TVM.
- Local embeddings model for javascript
-
this makes deploying AI language models so much easier
Link to github for those who want to know about MLC straight from them. Web demo is cool but takes a long time to load first time. https://github.com/mlc-ai/web-llm
-
April 2023
web-llm: Bringing large-language models and chat to web browsers. (https://github.com/mlc-ai/web-llm)
- Running a small model on a phone?
-
Weekly Megathread - 14 May 2023
WebLLM - https://mlc.ai/web-llm/
- WebLLM - Bringing LLMs based chatbot to your web browser
-
Google is bringing AI to the browser with WebGPU in Chrome
which makes this works in the browser
What are some alternatives?
ch32v003fun - An open source software development stack for the CH32V003, a 10¢ 48 MHz RISC-V Microcontroller
chainlit - Build Conversational AI in minutes ⚡️
duckdb-wasm - WebAssembly version of DuckDB
mlc-llm - Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
Waterlily - A project bringing ethics back to AI
gpt4all - gpt4all: run open-source LLMs anywhere
onnxruntime - ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
StableLM - StableLM: Stability AI Language Models
twisted - Fetching riot games api data
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
JsCron - Javascript cron parser, schedule date generator