Multilingual MMLU

Multilingual MMLU extends the Massive Multitask Language Understanding benchmark to multiple languages, evaluating language models' knowledge and reasoning capabilities across diverse linguistic contexts. This multilingual adaptation tests models' ability to understand and apply academic knowledge in various languages, assessing both subject matter expertise and cross-cultural knowledge transfer.