MEGA XStoryCloze
Multilingual
text
+
+
+
+
About
MEGA XStoryCloze is a multilingual story completion benchmark within the MEGA framework, evaluating language models' narrative understanding across 70 diverse languages. It tests models' ability to predict logical story endings by selecting the most coherent conclusion from multiple alternatives. The benchmark assesses cross-lingual story comprehension, narrative coherence understanding, and commonsense reasoning in multilingual contexts, particularly challenging for low-resource and non-Latin script languages.
+
+
+
+
Evaluation Stats
Total Models2
Organizations1
Verified Results0
Self-Reported2
+
+
+
+
Benchmark Details
Max Score1
Language
en
+
+
+
+
Performance Overview
Score distribution and top performers
Score Distribution
2 models
Top Score
82.8%
Average Score
78.1%
High Performers (80%+)
1Top Organizations
#1Microsoft
2 models
78.1%
+
+
+
+
Leaderboard
2 models ranked by performance on MEGA XStoryCloze
| License | Links | ||||
|---|---|---|---|---|---|
| Aug 23, 2024 | MIT | 82.8% | |||
| Aug 23, 2024 | MIT | 73.5% |
