gptqlora
chain-of-thought-hub
Our great sponsors
gptqlora | chain-of-thought-hub | |
---|---|---|
2 | 10 | |
94 | 2,361 | |
- | - | |
7.6 | 6.9 | |
11 months ago | 8 days ago | |
Python | Jupyter Notebook | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
gptqlora
-
(2/2) May 2023
GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ (https://github.com/qwopqwop200/gptqlora/tree/main)
-
GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
The difference from QLoRA is that GPTQ is used instead of NF4 (Normal Float4) + DQ (Double Quantization) for model quantization. The advantage is that you can expect better performance because it provides better quantization than conventional bitsandbytes. The downside is that it is a one-shot quantization methodology, so it is more inconvenient than bitsandbytes, and unlike bitsandbytes, it is not universal. I'm still experimenting, but it seems to work. At least, I hope it can be more options for people using LoRA. https://github.com/qwopqwop200/gptqlora/tree/main
chain-of-thought-hub
- Chain-Of-Thought Hub: Measuring LLMs' Reasoning Performance
-
All Model Leaderboards (that I know)
Chain-of-Thought Hub https://github.com/FranxYao/chain-of-thought-hub - these are mostly gathered although Yao Fu, the author is working on specific CoT runs
- It looks likely that the MMLU score on Hugginface's LLM leaderboard is wrong after all.
-
(2/2) May 2023
Chain-of-Thought Hub: Measuring LLMs' Reasoning Performance (https://github.com/FranxYao/chain-of-thought-hub)
-
Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
https://github.com/FranxYao/chain-of-thought-hub
- [N] Chain-of-Thought Hub: Measuring LLMs' Reasoning Performance
- Chain-of-Thought Hub: Measuring LLMs' Reasoning Performance
What are some alternatives?
tree-of-thoughts - Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
DB-GPT - AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents
GirlfriendGPT - Girlfriend GPT is a Python project to build your own AI girlfriend using ChatGPT4.0
llm-leaderboard - A joint community effort to create one central leaderboard for LLMs.
chathub - All-in-one chatbot client
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
airoboros - Customizable implementation of the self-instruct paper.
gorilla - Gorilla: An API store for LLMs
llm-humaneval-benchmarks