SaaSHub helps you find the best software and product alternatives Learn more →
Promptfoo Alternatives
Similar projects and alternatives to promptfoo
-
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
-
-
Tutanota makes encryption easy
Tuta is an email service with a strong focus on security and privacy that lets you encrypt emails, contacts and calendar entries on all your devices.
-
ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.
-
-
cli
Official Command Line Interface for the IPinfo API (IP geolocation and other types of IP data) (by ipinfo)
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
-
GrapesJS
Free and Open source Web Builder Framework. Next generation tool for building templates without coding
-
-
agenta
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.
-
-
-
cadence
Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.
-
-
autodistill
Images to inference with no labeling (use foundation models to train supervised models).
-
instant
Instant is a modern Firebase. We make you productive by giving your frontend a real-time database.
-
-
litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better promptfoo alternative or higher similarity.
promptfoo discussion
promptfoo reviews and mentions
Posts with mentions or reviews of promptfoo.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2025-02-03.
-
Ask HN: Who is hiring? (February 2025)
Promptfoo | Multiple Roles | Remote US (HQ: San Mateo, CA)
About us:
Promptfoo builds the leading open-source framework for LLM security and evaluation. Our tools help over 50,000 developers test and secure AI applications. Backed by a16z and led by YC alumni, we are shaping the future of AI safety.
Open Roles:
- Staff Engineers
- Research Engineers
- Developer Relations
How to apply:
- Try Promptfoo at <https://promptfoo.dev>
- Review our code at <https://github.com/promptfoo/promptfoo>
- Email [email protected] with "HN" in the subject, your GitHub/LinkedIn, and a brief note on why you're excited about our work.
Join us in building safer, more reliable AI.
-
Compare LLM's performance at scale with PromptFoo
In a business setting, where you have dozens of prompts and use cases across many models, you may want to automate this evaluation. Having a tool that supports such tasks can be very useful. One tool I frequently use is Promptfoo.
-
Ask HN: Who is hiring? (December 2024)
Try Promptfoo at https://promptfoo.dev and check out our GitHub at https://github.com/promptfoo/promptfoo. Then email your GitHub/LinkedIn and a short intro to [email protected]. Use "HN" in the subject line. Please try promptfoo before applying—strong preference will be given to candidates familiar with our work.
-
Ask HN: Who is hiring? (October 2024)
Promptfoo | Applied ML + Founding Sales Role | San Mateo, CA or REMOTE (US) | Full-time | https://promptfoo.dev
Promptfoo builds open-source pentesting and redteaming tools for LLMs. Our tools are used by over 35,000 developers at companies like Shopify, Amazon, and Anthropic, and OpenAI. We are backed by a16z and we’re hiring:
1. Senior / Staff Applied ML
- Promptfoo: Test your LLM app locally
- Why is promptfoo so popular?
- Promptfoo/promptfoo: Test your prompts, agents, and RAGs
-
Three Prompt Libraries you should know as a AI Engineer
Promptfoo
- Gemma 2: Improving Open Language Models at a Practical Size [pdf]
- Iterate on LLMs Faster
-
A note from our sponsor - SaaSHub
www.saashub.com | 8 Feb 2025
Stats
Basic promptfoo repo stats
33
5,433
10.0
3 days ago
promptfoo/promptfoo is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of promptfoo is TypeScript.
Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai