SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python prompt-engineering Projects
-
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
-
LLM answer quality directly relates to its given prompts, and therefore, effective prompt engineering is necessary. The landscape of prompt managing platforms and libraries increased manifold. Some tools now actively incorporate specific tweaks of the most recent commercial models, enabling the formulation of prompts that are injected with model-specific formulations. Example libraries are dspy, LMQL, Outlines, and Prompttools,
-
promptflow
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
Project mention: Harnessing OpenAI Assistant 2.0 for Named Entity Recognition in PHP/Symfony 7 | dev.to | 2024-12-19OpenAI Fine-Tuning Documentation Symfony Messenger Documentation OpenAI PHP Client Library PromptFlow Extension for VS Code
-
-
tree-of-thoughts
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
Just gonna leave this here: https://github.com/kyegomez/tree-of-thoughts/issues/78#issue...
-
swarms
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai
Worth noting there is an interesting multi-agent open source project named Swarms. When I saw this on X earlier I thought maybe the team had joined OpenAI but there's no connection between these projects
> "Swarms: The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework"
[0] https://github.com/kyegomez/swarms
[1] https://docs.swarms.world/en/latest/
-
Awesome-Prompt-Engineering
This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
prompttools
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
LLM answer quality directly relates to its given prompts, and therefore, effective prompt engineering is necessary. The landscape of prompt managing platforms and libraries increased manifold. Some tools now actively incorporate specific tweaks of the most recent commercial models, enabling the formulation of prompts that are injected with model-specific formulations. Example libraries are dspy, LMQL, Outlines, and Prompttools,
-
Project mention: Show HN: Times faster LLM evaluation with Bayesian optimization | news.ycombinator.com | 2024-02-13
Fair question.
Evaluate refers to the phase after training to check if the training is good.
Usually the flow goes training -> evaluation -> deployment (what you called inference). This project is aimed for evaluation. Evaluation can be slow (might even be slower than training if you're finetuning on a small domain specific subset)!
So there are [quite](https://github.com/microsoft/promptbench) [a](https://github.com/confident-ai/deepeval) [few](https://github.com/openai/evals) [frameworks](https://github.com/EleutherAI/lm-evaluation-harness) working on evaluation, however, all of them are quite slow, because LLM are slow if you don't have infinite money. [This](https://github.com/open-compass/opencompass) one tries to speed up by parallelizing on multiple computers, but none of them takes advantage of the fact that many evaluation queries might be similar and all try to evaluate on all given queries. And that's where this project might come in handy.
-
-
graph-of-thoughts
Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
-
uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
Project mention: UpTrain is an open-source unified platform to evaluate and improve Gen AI apps | news.ycombinator.com | 2024-09-10 -
-
agenta
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.
At Agenta, we make it easy for teams to collaborate on prompt engineering and manage the prompts of their AI applications. Agenta is an open-source LLMOps platform that allows you to adopt the best practices from leading teams for building AI applications.
-
PromptCraft-Robotics
Community for applying LLMs to robotics and a robot simulator with ChatGPT integration
-
Project mention: Securing and enhancing LLM prompts & outputs: A guide using Amazon Bedrock and open-source solutions | dev.to | 2024-10-01
Image source:https://llm-guard.com/
-
-
-
awesome-gpt-prompt-engineering
A curated list of awesome resources, tools, and other shiny things for LLM prompt engineering.
-
stable-diffusion-prompt-reader
A simple standalone viewer for reading prompts from Stable Diffusion generated image outside the webui.
-
prompt-poet
Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.
Project mention: PromptPoet: Revolutionizing LLM Prompt Design at Character.ai | news.ycombinator.com | 2024-08-07We are thrilled by the community's response to our new open-source project, PromptPoet, which has garnered nearly 400 GitHub stars in less than a week!
Check it out here: https://github.com/character-ai/prompt-poet
At Character.AI, we developed PromptPoet to make LLM prompt design accessible to both technical and non-technical users. We're excited to continue to invest in development of PromptPoet alongside the developer community.
Our immediate next step is to bring these syntax to the community of Character creators on our platform, enabling them to tailor interactions based on runtime attributes—like adjusting prompts according to the user's age or the length of the current conversation.
-
Kiln
The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.
Project mention: Show HN: Distill your own model from DeepSeek R1 in 30 mins (GUI) | news.ycombinator.com | 2025-02-06 -
vim-ai
AI-powered code assistant for Vim. Generate, edit and chat with GPT models like ChatGPT using OpenAI
I’ve been happy with vim-ai plugin: https://github.com/madox2/vim-ai
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Python prompt-engineering discussion
Python prompt-engineering related posts
-
Promptmap: A prompt injection scanner for LLM applications
-
Exploring AI for Refactoring at Scale
-
Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
-
Generative AI: A Personal Deep Dive – My Notes and Insights
-
Universal Personal Assistant with LLMs
-
How to Build a Chess Engine and Fail
-
Robust (Structured) Text Generation
-
A note from our sponsor - SaaSHub
www.saashub.com | 8 Feb 2025
Index
What are some of the best open-source prompt-engineering projects in Python? This list will help you:
# | Project | Stars |
---|---|---|
1 | awesome-chatgpt-zh | 10,990 |
2 | outlines | 10,543 |
3 | promptflow | 9,859 |
4 | aim | 5,339 |
5 | tree-of-thoughts | 4,433 |
6 | swarms | 4,416 |
7 | Awesome-Prompt-Engineering | 4,143 |
8 | prompttools | 2,777 |
9 | promptbench | 2,524 |
10 | AutoPrompt | 2,336 |
11 | graph-of-thoughts | 2,267 |
12 | uptrain | 2,239 |
13 | YiVal | 2,075 |
14 | agenta | 2,039 |
15 | PromptCraft-Robotics | 1,938 |
16 | llm-guard | 1,376 |
17 | diffusiondb | 1,234 |
18 | spacy-llm | 1,179 |
19 | awesome-gpt-prompt-engineering | 1,170 |
20 | stable-diffusion-prompt-reader | 1,118 |
21 | prompt-poet | 1,025 |
22 | Kiln | 1,007 |
23 | vim-ai | 814 |