dalai
chatgpt-web
| dalai | chatgpt-web | |
|---|---|---|
| 59 | 10 | |
| 13,060 | 1,702 | |
| - | - | |
| 6.5 | 9.3 | |
| 5 months ago | 8 days ago | |
| CSS | Svelte | |
| - | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dalai
-
Ask HN: What are the capabilities of consumer grade hardware to work with LLMs?
I agree, I've definitely seen way more information about running image synthesis models like Stable Diffusion locally than I have LLMs. It's counterintuitive to me that Stable Diffusion takes less RAM than an LLM, especially considering it still needs the word vectors. Goes to show I know nothing.
I guess it comes down to the requirement of a very high end (or multiple) GPU that makes it impractical for most vs just running it in Colab or something.
Tho there are some efforts:
https://github.com/cocktailpeanut/dalai
-
Meta to release open-source commercial AI model
If you're just looking to play with something locally for the first time, this is the simplest project I've found and has a simple web UI: https://github.com/cocktailpeanut/dalai
It works for 7B/13B/30B/65B LLaMA and Alpaca (fine-tuned LLaMA which definitely works better). The smaller models at least should run on pretty much any computer.
- How can I run a large language model locally?
- meirl
-
FreedomGPT: AI with no censorship
I am not against easy mode options dude, for example I used to run GANs through command line. I replaced them with Upscayl when I found it. Convenience is king after all. Something about this one isn't right though. They are advertising it as a model they built meanwhile their own github show it to be a frontend of LLAMA. Why aren't they honest about it? Why use bots to spam about it? This causes me to not trust the executable they share to 1 to 1 compliation of the source code neither. I would still recommend looking for more decent alternatives. Btw, running it directly isn't that complicated
-
Google removes the waitlist on Bard today and will be available in 180 more countries
https://github.com/ggerganov/llama.cpp https://github.com/oobabooga/text-generation-webui https://github.com/mlc-ai/mlc-llm https://github.com/cocktailpeanut/dalai https://github.com/ido-pluto/catai (this is super easy to install but it doesnt provide an api or have integration with langchain)
-
ChatGPT Data Breach BreakDown - Why it Should be a Concern for Everyone!
This was easy to get running: https://github.com/cocktailpeanut/dalai with alpaca 13B (on my 16GB or ram)
-
A brief history of LLaMA models
I had it running before with Dalai (https://github.com/cocktailpeanut/dalai) but have since moved to using the browser based WebGPU method (https://mlc.ai/web-llm/) which uses Vicuna 7B and is quite good.
-
Meet Atom the GPT Assistant, an AI-powered Smart Home Assistant. It's like Google Assistant but with endless possibility of ChatGPT, it's like Siri but with extensibility of Open Source power.
https://github.com/nsarrazin/serge let's you pick which model and runs in a container. For API https://github.com/cocktailpeanut/dalai looks super promising.
- Mercredi Tech - 2023-04-26
chatgpt-web
- GPT 4 new limits only 40 messages in 3 days
-
Llamafile lets you distribute and run LLMs with a single file
Wow, this is almost as good as chatgpt-web [0], and it works offline and is free. Amazing.
In case anyone here hasn't used chatgpt-web, I recommend trying it out. With the new GPT-4 models you can chat for way cheaper than paying for ChatGPT Plus, and you can also switch back to the older (non-nerfed) GPT-4 models that can still actually code.
[0]: https://github.com/Niek/chatgpt-web
-
best front end for API
Came across this: https://github.com/Niek/chatgpt-web
-
GPT4 Web Page that uses API Tokens
I tried asking AutoGPT to do it, but it spins its wheels. It can't even seem to access the folder, and I'm not running it in a docker. So I've given up on trying to code it myself. https://niek.github.io/chatgpt-web/ is basically what I need, but with GPT4, since 3.5 is already free.
- Show HN: SlickGPT
- Why somebody didn't already made an alternative client to chat.openai.com?
-
Easiest way to use GPT 3.5 on a desktop / mobile client?
And if you wanna just try it out they have it up on https://niek.github.io/chatgpt-web/
-
Yep...
Basically, with API, you pay per message. You can just enable it and try it out on a front-end like https://niek.github.io/chatgpt-web/ .
-
Show HN: Chat with GPT, a self-hosted open-source ChatGPT UI
Looks great! I have something very similar:
https://github.com/Niek/chatgpt-web
What are some alternatives?
gpt4all - gpt4all: run open-source LLMs anywhere
llamafile - Distribute and run LLMs with a single file.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
askai - Your simple terminal helper - A CLI integration with OpenAI's GPT3
llama - Inference code for Llama models
slickgpt - SlickGPT is a light-weight "use-your-own-API-key" web client for the OpenAI API written in Svelte. It offers GPT-4 integration, a userless share feature and other superpowers.
alpaca-lora - Instruct-tune LLaMA on consumer hardware
askai - Command Line Interface for OpenAi ChatGPT
llama.cpp - LLM inference in C/C++
plurality - A cornucopia of open source UIs built with ChatGPT API.
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
chatgpt-ui - ChatGPT UI with auth, OpenAI, Claude, Gemini support, written in Elixir + LiveView