MME

MME (Multimodal Large Language Model Evaluation) is a comprehensive benchmark measuring both perception and cognition abilities across 14 subtasks. It features manually designed instruction-answer pairs to avoid data leakage, evaluating 30+ advanced MLLMs on tasks ranging from basic visual recognition to complex reasoning. The benchmark reveals significant room for improvement in current multimodal models and provides quantitative analysis for model optimization.