ECLeKTic
Multilingual
text
+
+
+
+
About
ECLeKTic is a cross-lingual knowledge transfer benchmark featuring 384 unique questions across 11 languages, constructed from Wikipedia articles existing in only one language. Created by Google Research, this benchmark evaluates LLMs' ability to access and transfer knowledge across linguistic boundaries using closed-book question answering. ECLeKTic reveals knowledge accessibility discrepancies and measures multilingual reasoning capabilities.
+
+
+
+
Evaluation Stats
Total Models8
Organizations1
Verified Results0
Self-Reported8
+
+
+
+
Benchmark Details
Max Score1
Language
en
+
+
+
+
Performance Overview
Score distribution and top performers
Score Distribution
8 models
Top Score
19.0%
Average Score
7.4%
High Performers (80%+)
0Top Organizations
#1Google
8 models
7.4%
+
+
+
+
Leaderboard
8 models ranked by performance on ECLeKTic
| License | Links | ||||
|---|---|---|---|---|---|
| Jun 26, 2025 | Proprietary | 19.0% | |||
| Mar 12, 2025 | Gemma | 16.7% | |||
| Mar 12, 2025 | Gemma | 10.3% | |||
| Mar 12, 2025 | Gemma | 4.6% | |||
| Jun 26, 2025 | Proprietary | 2.5% | |||
| May 20, 2025 | Gemma | 2.5% | |||
| May 20, 2025 | Gemma | 1.9% | |||
| Mar 12, 2025 | Gemma | 1.4% |
