French MMLU
Multilingual
text
+
+
+
+
About
French MMLU is a French language adaptation of the Massive Multitask Language Understanding benchmark, evaluating AI models' knowledge and reasoning capabilities across diverse academic subjects in French. This benchmark tests models' understanding of French-specific cultural knowledge, academic content, and linguistic nuances across multiple domains, providing essential assessment for French language model capabilities and multilingual understanding.
+
+
+
+
Evaluation Stats
Total Models1
Organizations1
Verified Results0
Self-Reported1
+
+
+
+
Benchmark Details
Max Score1
Language
en
+
+
+
+
Performance Overview
Score distribution and top performers
Score Distribution
1 models
Top Score
57.5%
Average Score
57.5%
High Performers (80%+)
0Top Organizations
#1Mistral AI
1 model
57.5%
+
+
+
+
Leaderboard
1 models ranked by performance on French MMLU
| License | Links | ||||
|---|---|---|---|---|---|
| Oct 16, 2024 | Mistral Research License | 57.5% |
