prompttools
graph-of-thoughts
prompttools | graph-of-thoughts | |
---|---|---|
4 | 2 | |
2,468 | 1,895 | |
6.7% | 5.3% | |
9.6 | 6.4 | |
14 days ago | about 1 month ago | |
Python | Python | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
prompttools
-
Did GPT-4 really get worse? We built an evaluation framework so you can find out
Here's an example where we compare a few versions of GPT-4 against a locally run Llama 2 model: https://github.com/hegelai/prompttools/blob/main/examples/notebooks/GPT4vsLlama2.ipynb
- Experiment with HuggingFace, OpenAI, and other models using prompttools
- Prompttools: An AGPL-3.0 library for prompt testing and experimentation
-
prompttools: an open source python package for prompt engineers
I wanted to share a project I've been working on that I thought might be relevant to you all, prompttools! It's an open source library with tools for testing prompts, creating CI/CD, and running experiments across models and configurations. It uses notebooks and code so it'll be most helpful for folks approaching prompt engineering from a software background.
graph-of-thoughts
-
Q* Could Be It - Forget AlphaGO - It's Diplomacy - Peg 1 May Have Fallen - Noam Brown May Have Achieved The Improbable - Is this Q* Leak 2.0?
We introduce Graph of Thoughts (GoT): a framework that advances prompting capabilities in large language models (LLMs) beyond those offered by paradigms such as Chain-ofThought or Tree of Thoughts (ToT). The key idea and primary advantage of GoT is the ability to model the information generated by an LLM as an arbitrary graph, where units of information (“LLM thoughts”) are vertices, and edges correspond to dependencies between these vertices. This approach enables combining arbitrary LLM thoughts into synergistic outcomes, distilling the essence of whole networks of thoughts, or enhancing thoughts using feedback loops. We illustrate that GoT offers advantages over state of the art on different tasks, for example increasing the quality of sorting by 62% over ToT, while simultaneously reducing costs by >31%. We ensure that GoT is extensible with new thought transformations and thus can be used to spearhead new prompting schemes. This work brings the LLM reasoning closer to human thinking or brain mechanisms such as recurrence, both of which form complex networks. Website & code: https://github.com/spcl/graph-of-thoughts
-
Graph of Thoughts: Solving Elaborate Problems with Large Language Models
https://github.com/spcl/graph-of-thoughts Code for the paper too
What are some alternatives?
spacy-llm - 🦙 Integrating LLMs into structured NLP pipelines
trex - Enforce structured output from LLMs 100% of the time
cerche - Experimental search engine for conversational AI such as parl.ai, large language models such as OpenAI GPT3, and humans (maybe).
llm-guard - The Security Toolkit for LLM Interactions
ChatGPT-API-Python - Building a Chatbot in Python using OpenAI's Official ChatGPT API
prompt-lib - A set of utilities for running few-shot prompting experiments on large-language models
DPL - [NeurIPS 2023] Multi-fidelity hyperparameter optimization with deep power laws that achieves state-of-the-art results across diverse benchmarks.
ToolEmu - A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
FlexGen - Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput generation. [Moved to: https://github.com/FMInference/FlexGen]
ChainFury - 🦋 Production grade chaining engine behind TuneChat. Self host today!
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
promptmap - automatically tests prompt injection attacks on ChatGPT instances