Top 5 JavaScript language-model Projects
-
quillman
A chat app that transcribes audio in real-time, streams back a response from a language model, and synthesizes this response as natural-sounding speech.
-
gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
-
SurveyJS
Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.
-
IntelliNode
Access the latest AI models like ChatGPT, LLaMA, Diffusion, Gemini Hugging face, and beyond through a unified prompt layer and performance evaluation
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
https://github.com/modal-labs/quillman
I built something similar using WebKit speech recognition but that's limited to Chromium.
Here's a simple calculator for LLM inference requirements: https://rahulschand.github.io/gpu_poor/
Project mention: The simplest way for multi ML models integration | /r/u_Barqawiz_Coder | 2023-07-26
Project mention: KokoMind: Can LLMs Understand Social Interactions? | news.ycombinator.com | 2023-07-06
Project mention: Show HN: Next-token prediction in JavaScript – build fast LLMs from scratch | news.ycombinator.com | 2024-04-10Their library was actually made for dasher.. http://www.inference.org.uk/dasher/ - there was a web version being made (https://github.com/dasher-project/dasher-web We hit a bottleneck with the graphics driving. Note in dasher pretty much the entire tree is in dynamic view). Now this may help to understand the use case. Dasher is for people with disabilities who cant speak. It needs to be a personalised LM that trains on the fly and and keeps track of new words/sentences. But in truth too, utterances are usually small.
Don't get too knocked back by comments. A) If it works - it works. B) Your learning is as valuable as the outcome.
Oh have a look at https://imagineville.org/software/ for some other things that may be of interest..
Index
What are some of the best open-source language-model projects in JavaScript? This list will help you:
Project | Stars | |
---|---|---|
1 | quillman | 961 |
2 | gpu_poor | 650 |
3 | IntelliNode | 200 |
4 | KokoMind | 98 |
5 | dasher-web | 42 |
Sponsored