chain-of-thought-hub
ChatGPT-Primer
| chain-of-thought-hub | ChatGPT-Primer | |
|---|---|---|
| 10 | 1 | |
| 2,371 | 4 | |
| - | - | |
| 6.9 | 5.5 | |
| 10 days ago | 11 months ago | |
| Jupyter Notebook | ||
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
chain-of-thought-hub
- Chain-Of-Thought Hub: Measuring LLMs' Reasoning Performance
-
All Model Leaderboards (that I know)
Chain-of-Thought Hub https://github.com/FranxYao/chain-of-thought-hub - these are mostly gathered although Yao Fu, the author is working on specific CoT runs
- It looks likely that the MMLU score on Hugginface's LLM leaderboard is wrong after all.
-
(2/2) May 2023
Chain-of-Thought Hub: Measuring LLMs' Reasoning Performance (https://github.com/FranxYao/chain-of-thought-hub)
-
Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
https://github.com/FranxYao/chain-of-thought-hub
- [N] Chain-of-Thought Hub: Measuring LLMs' Reasoning Performance
- Chain-of-Thought Hub: Measuring LLMs' Reasoning Performance
ChatGPT-Primer
-
Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
I noticed that it tries to forward the User to external Sources more (Answering Query, and then "For further Info, just ask an Expert"), or tries to get the User to do the Work (Here is a nice Overview of the Program, now you do the rest of the coding).
If i don't want the RLHF to get in my Way, i switch over to the API (sadly not the 4.0 one).
I also noticed a decline in following Instructions, i have a Primer i am preseeding my Chats with.
The Primer ends with "Do you understand? [Y|N]", and ChatGPT 3.5 usually answered with a Summary, ChatGPT 4.0 in the beginning just wrote "Y".
Now it behaves like 3.5, answering with a Summary instead of a "Y". Adjusted the Prompt to -> "Confirm instructions with a short and precise "Ok"." which seems to work.
Used Primer: https://github.com/Kalabint/ChatGPT-Primer
What are some alternatives?
DB-GPT - AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents
llm-leaderboard - A joint community effort to create one central leaderboard for LLMs.
tree-of-thoughts - Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
airoboros - Customizable implementation of the self-instruct paper.
llm-humaneval-benchmarks
GirlfriendGPT - Girlfriend GPT is a Python project to build your own AI girlfriend using ChatGPT4.0
gptqlora - GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
pyllms - Minimal Python library to connect to LLMs (OpenAI, Anthropic, AI21, Cohere, Aleph Alpha, HuggingfaceHub, Google PaLM2, with a built-in model performance benchmark.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
gorilla - Gorilla: An API store for LLMs
llm-jeopardy - Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts