gptqlora
tree-of-thoughts
Our great sponsors
gptqlora | tree-of-thoughts | |
---|---|---|
2 | 26 | |
94 | 4,042 | |
- | - | |
7.6 | 8.8 | |
11 months ago | 2 months ago | |
Python | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
gptqlora
-
(2/2) May 2023
GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ (https://github.com/qwopqwop200/gptqlora/tree/main)
-
GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
The difference from QLoRA is that GPTQ is used instead of NF4 (Normal Float4) + DQ (Double Quantization) for model quantization. The advantage is that you can expect better performance because it provides better quantization than conventional bitsandbytes. The downside is that it is a one-shot quantization methodology, so it is more inconvenient than bitsandbytes, and unlike bitsandbytes, it is not universal. I'm still experimenting, but it seems to work. At least, I hope it can be more options for people using LoRA. https://github.com/qwopqwop200/gptqlora/tree/main
tree-of-thoughts
-
[D] Potential scammer on github stealing work of other ML researchers?
I checked the issues and found https://github.com/kyegomez/tree-of-thoughts/issues/78
-
(2/2) May 2023
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70% (https://github.com/kyegomez/tree-of-thoughts)
-
Statement on AI Extinction - Signed by AGI Labs, Top Academics, and Many Other Notable Figures
same deal with amplification research like Tree of Thoughts, AdaPlanner, and Ghost in the Minecraft. same deal with agentized LLMs like Auto-GPT emphasizing testing regimens. they want efficiency and explainability, not this "mine is bigger than yours" nonsense coming out of Microsoft, Google, or Meta (which isn't even the entire picture of the opensource ML research within those firms either). There's this idealized "neurosymbolic AI" where everyone just wants code to do a job, so there should only be so much probabilistic behavior to learn the jobs that aren't learned to begin with, but the fact remains that the actual researchers and engineers want something that is as deterministic as imperative language can be. perhaps we'll achieve functional depth, and instead of some outdated "paperclip maximizer", we summon Maxwell's demon via a "complete" Church-Turing thesis. in other words, while a "vastly superior being in intelligence" is a really bad time for anyone that has an intellect-based superiority complex, the rest of us are humble enough to utilize this information science to further explore the unknown.
- Tree of Thought (ToT) and AutoGPT
-
Tree of Thoughts
This is Shunyu, author of Tree oF Thoughts (arxiv.org/abs/2305.10601).
The official code to replicate paper results is https://github.com/ysymyth/tree-of-thought-llm
Not https://github.com/kyegomez/tree-of-thoughts which according to many who told me, is not right/good implementation of ToT, and damages the reputation of ToT
I explained the situation here: https://twitter.com/ShunyuYao12/status/1663946702754021383
I'd appreciate your help by unstaring his and staring mine, as currently Github and Google searches go to his repo by default, and it has been very misleading for many users.
-
Has anybody tried their models with "Tree of Thoughts"?
I hacked a dirty PR into this derivative repo, to run it with oobabooga API: https://github.com/kyegomez/tree-of-thoughts/pull/8
- Tree of Thoughts: Deliberate Problem Solving with LLMs
What are some alternatives?
GirlfriendGPT - Girlfriend GPT is a Python project to build your own AI girlfriend using ChatGPT4.0
Awesome-Prompt-Engineering - This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
chathub - All-in-one chatbot client
tree-of-thought-llm - [NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models
chain-of-thought-hub - Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
prompt-engineering - Tips and tricks for working with Large Language Models like OpenAI's GPT-4.
gorilla - Gorilla: An API store for LLMs
Mr.-Ranedeer-AI-Tutor - A GPT-4 AI Tutor Prompt for customizable personalized learning experiences.
airoboros - Customizable implementation of the self-instruct paper.
Neurite - Fractal Graph Desktop for Ai-Agents, Web-Browsing, Note-Taking, and Code.