Lmms-eval Alternatives
Similar projects and alternatives to lmms-eval based on common topics and language
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
langfuse-docs
🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps
-
-
-
mbodied-agents
Discontinued Seamlessly integrate state-of-the-art transformer models into robotics stacks [Moved to: https://github.com/mbodiai/embodied-agents]
-
-
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better lmms-eval alternative or higher similarity.
lmms-eval discussion
lmms-eval reviews and mentions
Posts with mentions or reviews of lmms-eval.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2026-06-03.
-
What is an LLM evaluation harness? A deep dive into lm-eval-harness
Multimodal is in prototype via hf-multimodal and vllm-vlm model types, with mmmu as the first real task. If you're doing vision-language, look at lmms-eval instead — it's a fork that has a much broader multimodal task coverage.
Stats
Basic lmms-eval repo stats
1
4,190
-
7 days ago
EvolvingLMMs-Lab/lmms-eval is an open source project licensed under GNU General Public License v3.0 or later which is an OSI approved license.
The primary programming language of lmms-eval is Python.
Popular Comparisons
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com