airoboros
tree-of-thoughts
airoboros | tree-of-thoughts | |
---|---|---|
8 | 26 | |
940 | 4,042 | |
- | - | |
8.7 | 8.8 | |
about 2 months ago | 2 months ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
airoboros
- TinyLlama project aims to pretrain a 1.1B Llama model on 3T tokens
- Airoboros: Customizable implementation of the self-instruct paper
-
airoboros (tool) overhaul
Just wanted to drop a note that I overhauled the airoboros tool not the models to have most of the prompts I've been using to build the datasets, plus a couple extras.
-
(2/2) May 2023
airoboros: using large language models to fine-tune large language models (https://github.com/jondurbin/airoboros)
-
Airoboros [7B/13B]
This is a fine-tuned LlaMa model, using completely synthetic training data created by https://github.com/jondurbin/airoboros
-
airobors-13b - 98% eval vs gpt-3.5-turbo
I used airoboros, a python tool I wrote, to generate the synthetic instruction response pairs, and included a jailbreak prompt to attempt to bypass OpenAI censorship. This is the only dataset used to fine-tune the model.
-
[P] airoboros 7b - instruction tuned on 100k synthetic instruction/responses
This is a 7b parameter, fine-tuned on 100k synthetic instruction/response pairs generated by gpt-3.5-turbo using my version of self-instruct airoboros
-
[P] airoboros: a rewrite of self-instruct/alpaca synthetic prompt generation
GitHub Repo
tree-of-thoughts
-
[D] Potential scammer on github stealing work of other ML researchers?
I checked the issues and found https://github.com/kyegomez/tree-of-thoughts/issues/78
-
(2/2) May 2023
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70% (https://github.com/kyegomez/tree-of-thoughts)
-
Statement on AI Extinction - Signed by AGI Labs, Top Academics, and Many Other Notable Figures
same deal with amplification research like Tree of Thoughts, AdaPlanner, and Ghost in the Minecraft. same deal with agentized LLMs like Auto-GPT emphasizing testing regimens. they want efficiency and explainability, not this "mine is bigger than yours" nonsense coming out of Microsoft, Google, or Meta (which isn't even the entire picture of the opensource ML research within those firms either). There's this idealized "neurosymbolic AI" where everyone just wants code to do a job, so there should only be so much probabilistic behavior to learn the jobs that aren't learned to begin with, but the fact remains that the actual researchers and engineers want something that is as deterministic as imperative language can be. perhaps we'll achieve functional depth, and instead of some outdated "paperclip maximizer", we summon Maxwell's demon via a "complete" Church-Turing thesis. in other words, while a "vastly superior being in intelligence" is a really bad time for anyone that has an intellect-based superiority complex, the rest of us are humble enough to utilize this information science to further explore the unknown.
- Tree of Thought (ToT) and AutoGPT
-
Tree of Thoughts
This is Shunyu, author of Tree oF Thoughts (arxiv.org/abs/2305.10601).
The official code to replicate paper results is https://github.com/ysymyth/tree-of-thought-llm
Not https://github.com/kyegomez/tree-of-thoughts which according to many who told me, is not right/good implementation of ToT, and damages the reputation of ToT
I explained the situation here: https://twitter.com/ShunyuYao12/status/1663946702754021383
I'd appreciate your help by unstaring his and staring mine, as currently Github and Google searches go to his repo by default, and it has been very misleading for many users.
-
Has anybody tried their models with "Tree of Thoughts"?
I hacked a dirty PR into this derivative repo, to run it with oobabooga API: https://github.com/kyegomez/tree-of-thoughts/pull/8
- Tree of Thoughts: Deliberate Problem Solving with LLMs
What are some alternatives?
WizardLM - Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath
Awesome-Prompt-Engineering - This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
TinyLlama - The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
tree-of-thought-llm - [NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models
WizardVicunaLM - LLM that combines the principles of wizardLM and vicunaLM
GirlfriendGPT - Girlfriend GPT is a Python project to build your own AI girlfriend using ChatGPT4.0
datablations - Scaling Data-Constrained Language Models
prompt-engineering - Tips and tricks for working with Large Language Models like OpenAI's GPT-4.
chain-of-thought-hub - Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
Mr.-Ranedeer-AI-Tutor - A GPT-4 AI Tutor Prompt for customizable personalized learning experiences.
gorilla - Gorilla: An API store for LLMs
Neurite - Fractal Graph Desktop for Ai-Agents, Web-Browsing, Note-Taking, and Code.