SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 prompt-engineering Open-Source Projects
-
-
generative-ai-for-beginners
18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
FinGPT
FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
-
-
promptflow
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
-
generative-ai
Sample code and notebooks for Generative AI on Google Cloud, including Gemini (by GoogleCloudPlatform)
-
Learning-Prompt
Free prompt engineering online course. ChatGPT and Midjourney tutorials are now included!
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
-
ai-notes
notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.
-
awesome-prompts
Curated list of chatgpt prompts from the top-rated GPTs in the GPTs Store. Prompt Engineering, prompt attack & prompt protect. Advanced Prompt Engineering papers.
-
Learn_Prompting
Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community
-
tree-of-thoughts
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
-
Awesome-Prompt-Engineering
This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
-
Promptify
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
-
promptfoo
Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.
-
prompttools
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
-
-
-
-
awesome-generative-ai
A curated list of Generative AI tools, works, models, and references (by filipecalegario)
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Prompt Engineering Guide is the holy grail of all guides, aiming to make it easier to stay up-to-date with prompt engineering guides, techniques, applications, and papers. If you are getting started, this is an excellent place to start.
Generative AI For Beginners: a collection of resources to learn about Generative AI, including tutorials, code samples, and more.
Project mention: GPT-4, without specialized training, beat a GPT-3.5 class model that cost $10B | news.ycombinator.com | 2024-03-24There is also the open source FinGPT, that is claimed to beat GPT4 in some benchmarks at a fine tuning cost of $17.25.
https://github.com/AI4Finance-Foundation/FinGPT
Project mention: A suite of tools designed to streamline the development cycle of LLM-based apps | news.ycombinator.com | 2024-04-12
I've used the code based on similar examples from GitHub [1]. According to docs [2], imagegeneration@005 was released on the 11th, so I guessed it's Imagen 2, though there are no confirmations.
[1] https://github.com/GoogleCloudPlatform/generative-ai/blob/ma...
[2] https://console.cloud.google.com/vertex-ai/publishers/google...
Project mention: A free systematic course on how to write a good Midjourney or ChatGPT prompt | news.ycombinator.com | 2023-08-14
Project mention: Adding a streaming run function to the Assistants API | news.ycombinator.com | 2024-02-07
Project mention: Minimal implementation of Mamba, the new LLM architecture, in 1 file of PyTorch | news.ycombinator.com | 2023-12-20the field just moves fast. I have curated a list of non-hypey writers and youtubers who explain these things for a typical SWE audience if you are interested. https://github.com/swyxio/ai-notes/blob/main/Resources/Good%...
Awesome-GPTs-Prompts is a curated list of prompts from the top-rated GPTs so that you can unlock the magic behind large language models more easily.
Project mention: Ask HN: Where to learn the cutting edge of prompt engineering? | news.ycombinator.com | 2023-12-10- https://learnprompting.org
Project mention: [D] Potential scammer on github stealing work of other ML researchers? | /r/MachineLearning | 2023-08-17I checked the issues and found https://github.com/kyegomez/tree-of-thoughts/issues/78
Project mention: Promptify 2.0: More Structured, More Powerful LLMs with Prompt-Optimization, Prompt-Engineering, and Structured Json Parsing with GPT-n Models! 🚀 | /r/ArtificialInteligence | 2023-07-31First up, a huge Thank You for making Promptify a hit with over 2.3k+ stars on Github ! 🌟
Project mention: Google CodeGemma: Open Code Models Based on Gemma [pdf] | news.ycombinator.com | 2024-04-09
Project mention: Did GPT-4 really get worse? We built an evaluation framework so you can find out | /r/ChatGPT | 2023-07-24Here's an example where we compare a few versions of GPT-4 against a locally run Llama 2 model: https://github.com/hegelai/prompttools/blob/main/examples/notebooks/GPT4vsLlama2.ipynb
Project mention: YiVal——Unlocking Your Data's Power to Create Customized GenAI Apps | /r/u_YiVal | 2023-11-16- 🤖Github:https://github.com/YiVal/YiVal/pull/189
Project mention: Ask HN: How does deploying a fine-tuned model work | news.ycombinator.com | 2024-04-23- Fireworks: $0.20
If you're looking for an end-to-end flow that will help you gather the training data, validate it, run the fine tune and then define evaluations, you could also check out my company, OpenPipe (https://openpipe.ai/). In addition to hosting your model, we help you organize your training data, relabel if necessary, define evaluations on the finished fine-tune, and monitor its performance in production. Our inference prices are higher than the above providers, but once you're happy with your model you can always export your weights and host them on one of the above!
Project mention: Show HN: Times faster LLM evaluation with Bayesian optimization | news.ycombinator.com | 2024-02-13Fair question.
Evaluate refers to the phase after training to check if the training is good.
Usually the flow goes training -> evaluation -> deployment (what you called inference). This project is aimed for evaluation. Evaluation can be slow (might even be slower than training if you're finetuning on a small domain specific subset)!
So there are [quite](https://github.com/microsoft/promptbench) [a](https://github.com/confident-ai/deepeval) [few](https://github.com/openai/evals) [frameworks](https://github.com/EleutherAI/lm-evaluation-harness) working on evaluation, however, all of them are quite slow, because LLM are slow if you don't have infinite money. [This](https://github.com/open-compass/opencompass) one tries to speed up by parallelizing on multiple computers, but none of them takes advantage of the fact that many evaluation queries might be similar and all try to evaluate on all given queries. And that's where this project might come in handy.
Project mention: Generative AI – A curated list of Generative AI tools, works, models | news.ycombinator.com | 2023-07-14
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
prompt-engineering related posts
-
Prompt Tower v0.1.9 – Batch file selection
-
Prompt Tower v0.1.9 – batch file selection
-
Top Open Source Prompt Engineering Guides & Tools🔧🏗️🚀
-
Ollama v0.1.33 with Llama 3, Phi 3, and Qwen 110B
-
Meta Llama 3
-
OpenAI: Improvements to the fine-tuning API and expanding our cus
-
Show HN: I made a library for LLM prompt injection/exploit/jailbreak detection
-
A note from our sponsor - SaaSHub
www.saashub.com | 10 May 2024
Index
What are some of the best open-source prompt-engineering projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | Prompt-Engineering-Guide | 44,105 |
| 2 | generative-ai-for-beginners | 43,438 |
| 3 | FinGPT | 11,544 |
| 4 | awesome-chatgpt-zh | 9,958 |
| 5 | promptflow | 8,204 |
| 6 | generative-ai | 5,556 |
| 7 | Learning-Prompt | 5,077 |
| 8 | aim | 4,816 |
| 9 | gateway | 4,647 |
| 10 | ai-notes | 4,581 |
| 11 | awesome-prompts | 4,353 |
| 12 | Learn_Prompting | 4,172 |
| 13 | tree-of-thoughts | 4,046 |
| 14 | Awesome-Prompt-Engineering | 3,234 |
| 15 | Promptify | 3,046 |
| 16 | promptfoo | 2,830 |
| 17 | Awesome-ChatGPT-prompts-ZH_CN | 2,562 |
| 18 | prompttools | 2,442 |
| 19 | YiVal | 2,436 |
| 20 | OpenPipe | 2,381 |
| 21 | The-HustleGPT-Challenge | 2,094 |
| 22 | promptbench | 2,079 |
| 23 | awesome-generative-ai | 2,036 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com