Gemma 2 9B
Zero-eval
#2ARC-E
#3BoolQ
#3PIQA
+3 more
by Google
+
+
+
+
About
Gemma 2 9B was created as a more compact open-source model, designed to deliver capable performance with reduced computational requirements. Built with 9 billion parameters and instruction tuning, it serves applications where efficiency and accessibility are valued alongside the benefits of open-source availability.
+
+
+
+
Timeline
AnnouncedJun 27, 2024
ReleasedJun 27, 2024
+
+
+
+
Specifications
Training Tokens8.0T
+
+
+
+
License & Family
License
Gemma
Performance Overview
Performance metrics and category breakdown
Overall Performance
16 benchmarks
Average Score
64.6%
Best Score
88.0%
High Performers (80%+)
5+
+
+
+
All Benchmark Results for Gemma 2 9B
Complete list of benchmark scores with detailed information
| ARC-E | text | 0.88 | 88.0% | Self-reported | |
| BoolQ | text | 0.84 | 84.2% | Self-reported | |
| HellaSwag | text | 0.82 | 81.9% | Self-reported | |
| PIQA | text | 0.82 | 81.7% | Self-reported | |
| Winogrande | text | 0.81 | 80.6% | Self-reported | |
| TriviaQA | text | 0.77 | 76.6% | Self-reported | |
| MMLU | text | 0.71 | 71.3% | Self-reported | |
| GSM8k | text | 0.69 | 68.6% | Self-reported | |
| ARC-C | text | 0.68 | 68.4% | Self-reported | |
| BIG-Bench | text | 0.68 | 68.2% | Self-reported |
Showing 1 to 10 of 16 benchmarks
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+