MMMLU

MMMLU (Multilingual Massive Multitask Language Understanding) extends the MMLU benchmark to multiple languages, evaluating language models' knowledge and reasoning capabilities across diverse linguistic contexts. This multilingual adaptation tests models' ability to understand and apply academic knowledge in various languages, assessing both linguistic competency and cross-cultural knowledge transfer.