GPQA Chemistry

text
+
+
+
+
About

GPQA Chemistry is a specialized subset of the GPQA benchmark concentrating on graduate-level chemistry questions. This rigorous evaluation tests AI models' advanced understanding of chemical principles, reactions, and theoretical concepts through expert-crafted multiple-choice questions. GPQA Chemistry assesses sophisticated chemical reasoning and problem-solving capabilities requiring deep domain expertise in chemistry.

+
+
+
+
Evaluation Stats
Total Models1
Organizations1
Verified Results0
Self-Reported1
+
+
+
+
Benchmark Details
Max Score1
Language
en
+
+
+
+
Performance Overview
Score distribution and top performers

Score Distribution

1 models
Top Score
64.7%
Average Score
64.7%
High Performers (80%+)
0

Top Organizations

#1OpenAI
1 model
64.7%
+
+
+
+
Leaderboard
1 models ranked by performance on GPQA Chemistry
LicenseLinks
Dec 17, 2024
Proprietary
64.7%
+
+
+
+
Resources