Dalai Alternatives

dalai reviews and mentions

• Ask HN: What are the capabilities of consumer grade hardware to work with LLMs?
  1 project | news.ycombinator.com | 3 Aug 2023

  I agree, I've definitely seen way more information about running image synthesis models like Stable Diffusion locally than I have LLMs. It's counterintuitive to me that Stable Diffusion takes less RAM than an LLM, especially considering it still needs the word vectors. Goes to show I know nothing.

  I guess it comes down to the requirement of a very high end (or multiple) GPU that makes it impractical for most vs just running it in Colab or something.

  Tho there are some efforts:

  https://github.com/cocktailpeanut/dalai

• Meta to release open-source commercial AI model
  3 projects | news.ycombinator.com | 14 Jul 2023

  If you're just looking to play with something locally for the first time, this is the simplest project I've found and has a simple web UI: https://github.com/cocktailpeanut/dalai

  It works for 7B/13B/30B/65B LLaMA and Alpaca (fine-tuned LLaMA which definitely works better). The smaller models at least should run on pretty much any computer.

• How can I run a large language model locally?
  1 project | /r/learnprogramming | 11 Jul 2023
• meirl
  1 project | /r/meirl | 22 May 2023
• FreedomGPT: AI with no censorship
  3 projects | /r/KotakuInAction | 12 May 2023

  I am not against easy mode options dude, for example I used to run GANs through command line. I replaced them with Upscayl when I found it. Convenience is king after all. Something about this one isn't right though. They are advertising it as a model they built meanwhile their own github show it to be a frontend of LLAMA. Why aren't they honest about it? Why use bots to spam about it? This causes me to not trust the executable they share to 1 to 1 compliation of the source code neither. I would still recommend looking for more decent alternatives. Btw, running it directly isn't that complicated

• Google removes the waitlist on Bard today and will be available in 180 more countries
  6 projects | /r/artificial | 10 May 2023

  https://github.com/ggerganov/llama.cpp https://github.com/oobabooga/text-generation-webui https://github.com/mlc-ai/mlc-llm https://github.com/cocktailpeanut/dalai https://github.com/ido-pluto/catai (this is super easy to install but it doesnt provide an api or have integration with langchain)

• ChatGPT Data Breach BreakDown - Why it Should be a Concern for Everyone!
  2 projects | /r/programming | 7 May 2023

  This was easy to get running: https://github.com/cocktailpeanut/dalai with alpaca 13B (on my 16GB or ram)

• A brief history of LLaMA models
  8 projects | news.ycombinator.com | 29 Apr 2023

  I had it running before with Dalai (https://github.com/cocktailpeanut/dalai) but have since moved to using the browser based WebGPU method (https://mlc.ai/web-llm/) which uses Vicuna 7B and is quite good.

• Meet Atom the GPT Assistant, an AI-powered Smart Home Assistant. It's like Google Assistant but with endless possibility of ChatGPT, it's like Siri but with extensibility of Open Source power.
  6 projects | /r/homeautomation | 27 Apr 2023

  https://github.com/nsarrazin/serge let's you pick which model and runs in a container. For API https://github.com/cocktailpeanut/dalai looks super promising.

• Mercredi Tech - 2023-04-26
  6 projects | /r/france | 26 Apr 2023
• A note from our sponsor - SaaSHub
  www.saashub.com | 8 Dec 2024

  SaaSHub helps you find the best software and product alternatives Learn more →