Gemma 2 9B
Zero-eval
#2ARC-E
#3BoolQ
#3PIQA
+3 more
by Google
+
+
+
+
About
Gemma 2 9B is a language model developed by Google. It achieves strong performance with an average score of 64.6% across 16 benchmarks. It excels particularly in ARC-E (88.0%), BoolQ (84.2%), HellaSwag (81.9%). It's licensed for commercial use, making it suitable for enterprise applications. Released in 2024, it represents Google's latest advancement in AI technology.
+
+
+
+
Timeline
AnnouncedJun 27, 2024
ReleasedJun 27, 2024
+
+
+
+
Specifications
Training Tokens8.0T
+
+
+
+
License & Family
License
Gemma
Performance Overview
Performance metrics and category breakdown
Overall Performance
16 benchmarks
Average Score
64.6%
Best Score
88.0%
High Performers (80%+)
5+
+
+
+
All Benchmark Results for Gemma 2 9B
Complete list of benchmark scores with detailed information
| ARC-E | text | 0.88 | 88.0% | Self-reported | |
| BoolQ | text | 0.84 | 84.2% | Self-reported | |
| HellaSwag | text | 0.82 | 81.9% | Self-reported | |
| PIQA | text | 0.82 | 81.7% | Self-reported | |
| Winogrande | text | 0.81 | 80.6% | Self-reported | |
| TriviaQA | text | 0.77 | 76.6% | Self-reported | |
| MMLU | text | 0.71 | 71.3% | Self-reported | |
| GSM8k | text | 0.69 | 68.6% | Self-reported | |
| ARC-C | text | 0.68 | 68.4% | Self-reported | |
| BIG-Bench | text | 0.68 | 68.2% | Self-reported |
Showing 1 to 10 of 16 benchmarks