Python prompt-engineering

Open-source Python projects categorized as prompt-engineering

Top 23 Python prompt-engineering Projects

prompt-engineering
  1. awesome-chatgpt-zh

    ChatGPT 中文指南🔥,ChatGPT 中文调教指南,指令指南,应用开发指南,精选资源清单,更好的使用 chatGPT 让你的生产力 up up up! 🚀

  2. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  3. outlines

    Structured Text Generation

    Project mention: Universal Personal Assistant with LLMs | dev.to | 2024-12-11

    LLM answer quality directly relates to its given prompts, and therefore, effective prompt engineering is necessary. The landscape of prompt managing platforms and libraries increased manifold. Some tools now actively incorporate specific tweaks of the most recent commercial models, enabling the formulation of prompts that are injected with model-specific formulations. Example libraries are dspy, LMQL, Outlines, and Prompttools,

  4. promptflow

    Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

    Project mention: Harnessing OpenAI Assistant 2.0 for Named Entity Recognition in PHP/Symfony 7 | dev.to | 2024-12-19

    OpenAI Fine-Tuning Documentation Symfony Messenger Documentation OpenAI PHP Client Library PromptFlow Extension for VS Code

  5. aim

    Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

  6. tree-of-thoughts

    Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%

    Project mention: Swarm, a new agent framework by OpenAI | news.ycombinator.com | 2024-10-11

    Just gonna leave this here: https://github.com/kyegomez/tree-of-thoughts/issues/78#issue...

  7. swarms

    The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

    Project mention: Swarm, a new agent framework by OpenAI | news.ycombinator.com | 2024-10-11

    Worth noting there is an interesting multi-agent open source project named Swarms. When I saw this on X earlier I thought maybe the team had joined OpenAI but there's no connection between these projects

    > "Swarms: The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework"

    [0] https://github.com/kyegomez/swarms

    [1] https://docs.swarms.world/en/latest/

  8. Awesome-Prompt-Engineering

    This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. prompttools

    Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

    Project mention: Universal Personal Assistant with LLMs | dev.to | 2024-12-11

    LLM answer quality directly relates to its given prompts, and therefore, effective prompt engineering is necessary. The landscape of prompt managing platforms and libraries increased manifold. Some tools now actively incorporate specific tweaks of the most recent commercial models, enabling the formulation of prompts that are injected with model-specific formulations. Example libraries are dspy, LMQL, Outlines, and Prompttools,

  11. promptbench

    A unified evaluation framework for large language models

    Project mention: Show HN: Times faster LLM evaluation with Bayesian optimization | news.ycombinator.com | 2024-02-13

    Fair question.

    Evaluate refers to the phase after training to check if the training is good.

    Usually the flow goes training -> evaluation -> deployment (what you called inference). This project is aimed for evaluation. Evaluation can be slow (might even be slower than training if you're finetuning on a small domain specific subset)!

    So there are [quite](https://github.com/microsoft/promptbench) [a](https://github.com/confident-ai/deepeval) [few](https://github.com/openai/evals) [frameworks](https://github.com/EleutherAI/lm-evaluation-harness) working on evaluation, however, all of them are quite slow, because LLM are slow if you don't have infinite money. [This](https://github.com/open-compass/opencompass) one tries to speed up by parallelizing on multiple computers, but none of them takes advantage of the fact that many evaluation queries might be similar and all try to evaluate on all given queries. And that's where this project might come in handy.

  12. AutoPrompt

    A framework for prompt tuning using Intent-based Prompt Calibration

    Project mention: FLaNK 04 March 2024 | dev.to | 2024-03-04
  13. graph-of-thoughts

    Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"

  14. uptrain

    UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

    Project mention: UpTrain is an open-source unified platform to evaluate and improve Gen AI apps | news.ycombinator.com | 2024-09-10
  15. YiVal

    Your Automatic Prompt Engineering Assistant for GenAI Applications

  16. agenta

    The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.

    Project mention: The Definitive Guide to Prompt Management Systems | dev.to | 2025-01-24

    At Agenta, we make it easy for teams to collaborate on prompt engineering and manage the prompts of their AI applications. Agenta is an open-source LLMOps platform that allows you to adopt the best practices from leading teams for building AI applications.

  17. PromptCraft-Robotics

    Community for applying LLMs to robotics and a robot simulator with ChatGPT integration

  18. llm-guard

    The Security Toolkit for LLM Interactions

    Project mention: Securing and enhancing LLM prompts & outputs: A guide using Amazon Bedrock and open-source solutions | dev.to | 2024-10-01

    Image source:https://llm-guard.com/

  19. diffusiondb

    A large-scale text-to-image prompt gallery dataset based on Stable Diffusion

  20. spacy-llm

    🦙 Integrating LLMs into structured NLP pipelines

  21. awesome-gpt-prompt-engineering

    A curated list of awesome resources, tools, and other shiny things for LLM prompt engineering.

  22. stable-diffusion-prompt-reader

    A simple standalone viewer for reading prompts from Stable Diffusion generated image outside the webui.

  23. prompt-poet

    Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

    Project mention: PromptPoet: Revolutionizing LLM Prompt Design at Character.ai | news.ycombinator.com | 2024-08-07

    We are thrilled by the community's response to our new open-source project, PromptPoet, which has garnered nearly 400 GitHub stars in less than a week!

    Check it out here: https://github.com/character-ai/prompt-poet

    At Character.AI, we developed PromptPoet to make LLM prompt design accessible to both technical and non-technical users. We're excited to continue to invest in development of PromptPoet alongside the developer community.

    Our immediate next step is to bring these syntax to the community of Character creators on our platform, enabling them to tailor interactions based on runtime attributes—like adjusting prompts according to the user's age or the length of the current conversation.

  24. Kiln

    The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

    Project mention: Show HN: Distill your own model from DeepSeek R1 in 30 mins (GUI) | news.ycombinator.com | 2025-02-06
  25. vim-ai

    AI-powered code assistant for Vim. Generate, edit and chat with GPT models like ChatGPT using OpenAI

    Project mention: gptel: A simple LLM client for Emacs | news.ycombinator.com | 2024-11-03

    I’ve been happy with vim-ai plugin: https://github.com/madox2/vim-ai

  26. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python prompt-engineering discussion

Log in or Post with

Python prompt-engineering related posts

  • Promptmap: A prompt injection scanner for LLM applications

    1 project | news.ycombinator.com | 22 Jan 2025
  • Exploring AI for Refactoring at Scale

    5 projects | dev.to | 19 Jan 2025
  • Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps

    6 projects | news.ycombinator.com | 17 Dec 2024
  • Generative AI: A Personal Deep Dive – My Notes and Insights

    6 projects | dev.to | 15 Dec 2024
  • Universal Personal Assistant with LLMs

    13 projects | dev.to | 11 Dec 2024
  • How to Build a Chess Engine and Fail

    2 projects | news.ycombinator.com | 19 Nov 2024
  • Robust (Structured) Text Generation

    1 project | news.ycombinator.com | 15 Oct 2024
  • A note from our sponsor - SaaSHub
    www.saashub.com | 8 Feb 2025
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source prompt-engineering projects in Python? This list will help you:

# Project Stars
1 awesome-chatgpt-zh 10,990
2 outlines 10,543
3 promptflow 9,859
4 aim 5,339
5 tree-of-thoughts 4,433
6 swarms 4,416
7 Awesome-Prompt-Engineering 4,143
8 prompttools 2,777
9 promptbench 2,524
10 AutoPrompt 2,336
11 graph-of-thoughts 2,267
12 uptrain 2,239
13 YiVal 2,075
14 agenta 2,039
15 PromptCraft-Robotics 1,938
16 llm-guard 1,376
17 diffusiondb 1,234
18 spacy-llm 1,179
19 awesome-gpt-prompt-engineering 1,170
20 stable-diffusion-prompt-reader 1,118
21 prompt-poet 1,025
22 Kiln 1,007
23 vim-ai 814

Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai

Did you know that Python is
the 2nd most popular programming language
based on number of references?