MMLU French
Multilingual
text
+
+
+
+
About
MMLU-French is a French-language adaptation of the Massive Multitask Language Understanding benchmark, evaluating multilingual language models' knowledge and reasoning capabilities in French across 57 academic domains. This localized version tests models' ability to understand and apply knowledge in French educational and professional contexts.
+
+
+
+
Evaluation Stats
Total Models1
Organizations1
Verified Results0
Self-Reported1
+
+
+
+
Benchmark Details
Max Score1
Language
fr
+
+
+
+
Performance Overview
Score distribution and top performers
Score Distribution
1 models
Top Score
82.8%
Average Score
82.8%
High Performers (80%+)
1Top Organizations
#1Mistral AI
1 model
82.8%
+
+
+
+
Leaderboard
1 models ranked by performance on MMLU French
| License | Links | ||||
|---|---|---|---|---|---|
| Jul 24, 2024 | Mistral Research License | 82.8% |
