MVBench

MVBench is a comprehensive multimodal video understanding benchmark covering 20 challenging video tasks that cannot be effectively solved with a single frame. It employs a novel static-to-dynamic method to generate temporal-related tasks, evaluating models' temporal understanding capabilities ranging from perception to cognition through multiple-choice QA format with ground-truth video annotations.