MLVU

MLVU (Multi-task Long Video Understanding Benchmark) is a comprehensive benchmark designed to evaluate Multimodal Large Language Models on long video understanding tasks. It features videos of varying lengths across diverse genres including movies, surveillance footage, egocentric videos, cartoons, and game videos. The benchmark assesses key capabilities like temporal reasoning, event understanding, and context modeling across extended video sequences, revealing significant performance challenges for current models.