NQ
text
+
+
+
+
About
NQ (Natural Questions) is an abbreviated reference to the Natural Questions benchmark, featuring real user queries from Google Search paired with Wikipedia articles. It evaluates reading comprehension and question-answering capabilities by testing models' ability to find and extract accurate answers from real-world documents in authentic information-seeking scenarios.
+
+
+
+
Evaluation Stats
Total Models1
Organizations1
Verified Results0
Self-Reported1
+
+
+
+
Benchmark Details
Max Score1
Language
en
+
+
+
+
Performance Overview
Score distribution and top performers
Score Distribution
1 models
Top Score
36.5%
Average Score
36.5%
High Performers (80%+)
0Top Organizations
#1IBM
1 model
36.5%
+
+
+
+
Leaderboard
1 models ranked by performance on NQ
| License | Links | ||||
|---|---|---|---|---|---|
| Apr 16, 2025 | Apache 2.0 | 36.5% |
