tree-of-thoughts VS qlora

I checked the issues and found https://github.com/kyegomez/tree-of-thoughts/issues/78

Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70% (https://github.com/kyegomez/tree-of-thoughts)

same deal with amplification research like Tree of Thoughts, AdaPlanner, and Ghost in the Minecraft. same deal with agentized LLMs like Auto-GPT emphasizing testing regimens. they want efficiency and explainability, not this "mine is bigger than yours" nonsense coming out of Microsoft, Google, or Meta (which isn't even the entire picture of the opensource ML research within those firms either). There's this idealized "neurosymbolic AI" where everyone just wants code to do a job, so there should only be so much probabilistic behavior to learn the jobs that aren't learned to begin with, but the fact remains that the actual researchers and engineers want something that is as deterministic as imperative language can be. perhaps we'll achieve functional depth, and instead of some outdated "paperclip maximizer", we summon Maxwell's demon via a "complete" Church-Turing thesis. in other words, while a "vastly superior being in intelligence" is a really bad time for anyone that has an intellect-based superiority complex, the rest of us are humble enough to utilize this information science to further explore the unknown.

This is Shunyu, author of Tree oF Thoughts (arxiv.org/abs/2305.10601).

The official code to replicate paper results is https://github.com/ysymyth/tree-of-thought-llm

Not https://github.com/kyegomez/tree-of-thoughts which according to many who told me, is not right/good implementation of ToT, and damages the reputation of ToT

I explained the situation here: https://twitter.com/ShunyuYao12/status/1663946702754021383

I'd appreciate your help by unstaring his and staring mine, as currently Github and Google searches go to his repo by default, and it has been very misleading for many users.

I hacked a dirty PR into this derivative repo, to run it with oobabooga API: https://github.com/kyegomez/tree-of-thoughts/pull/8

Marx 3B V3 is StableLM 3B 4E1T instruction tuned on EverythingLM Data V3(ShareGPT Format) for 2 epochs using QLoRA.

https://github.com/artidoro/qlora

The tools and mechanisms to get a model to do what you want is ever so changing, ever so quickly. Build and understand a notebook yourself, and reduce dependencies. You will need to switch them.

My own project right now is still in raw generated form, and this now makes me think about trying qlora's scripts since this gives me some confidence I should be able to get it to turn out now that someone else has carved a path and charted the map. I was going to target llamatune which was mentioned here the other day.

Most papers I did read showed at least a thousand, even 10000 at several cases, so I assumed that to be the trend in the case of Low rank adapter(PEFT) training.(source: [2305.14314] QLoRA: Efficient Finetuning of Quantized LLMs (arxiv.org) , Stanford CRFM (Alpaca) and the minimum being openchat/openchat · Hugging Face ; There are a lot more examples)

4-bit quantization training mainly refers to qlora. Simply put, qlora quantizes the weights of the LLM into 4-bit for storage, while dequantizing them into 16-bit during the training process to ensure training precision. This method significantly reduces GPU memory overhead during training (the training speed should not vary much). This approach is highly suitable to be combined with parameter-efficient methods. However, the original paper was designed for single-modal LLMs and the code has already been wrapped in HuggingFace's library. Therefore, we extracted the core code from HuggingFace's library and migrated it into LaVIN's code. The main principle is to replace all linear layers in LLM with 4-bit quantized layers. Those interested can refer to our implementation in quantization.py and mm_adaptation.py, which is roughly a dozen lines of code.

There have been some new development like QLora which help fine-tune LLMs without updating all the weights.

This might be helpful: https://github.com/artidoro/qlora/issues/10

curious, since qlora paper only reports lora/qlora comparison for full fine-tuning for small 7B models.for 13B/33B/65B, it does not do so (table 4 in paper)it would be helpful if anyone can please provide links where I can read more on efficacy of lora or disadvantages of lora?

This might not be appropriate answer but did you take a look at this repository? https://github.com/artidoro/qlora With artidoro's repository it's pretty easy to train qlora. You just prepare your own dataset and run the following command: python qlora.py --model_name_or_path --dataset="path/to/your/dataset" --dataset_format="self-instruct" This is only available for several dataset formats. But every dataset format has to have input-output pairs. So the dataset json format has to be like this [ { “input”: “something ”, “output”:“something ” }, { “input”: “something ”, “output”:“something ” } ]