MMBench

MMBench is a systematically designed bilingual benchmark for robust evaluation of large vision-language models. It features meticulously curated multiple-choice questions in both English and Chinese, employing a rigorous CircularEval strategy to ensure accurate assessment. The benchmark evaluates multimodal perception and reasoning abilities across diverse visual understanding tasks, providing comprehensive evaluation of VLMs' capabilities with well-designed quality control schemes.