deepeval
Unit Testing For LLMs [Moved to: https://github.com/confident-ai/deepeval] (by mr-gpt)
agentops
Open source Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen (by AgentOps-AI)
| deepeval | agentops | |
|---|---|---|
| 3 | 2 | |
| 232 | 731 | |
| - | 55.3% | |
| 10.0 | 9.5 | |
| 9 months ago | 6 days ago | |
| Python | Python | |
| Apache License 2.0 | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
deepeval
Posts with mentions or reviews of deepeval.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-08-16.
agentops
Posts with mentions or reviews of agentops.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-08-16.
What are some alternatives?
When comparing deepeval and agentops you can also consider the following projects:
agenta - The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
bettertest
evadb - Database system for AI-powered apps
promptfoo - Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.
ai-notes - notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.
magentic - Seamlessly integrate LLMs as Python functions