MathVista-Mini
multimodal
+
+
+
+
About
MathVista-Mini is a streamlined subset of the MathVista benchmark designed for efficient evaluation of mathematical visual reasoning capabilities. This compact version provides representative coverage of mathematical reasoning in visual contexts while reducing computational requirements, testing AI models' ability to interpret and solve mathematical problems with visual elements through a curated selection of examples.
+
+
+
+
Evaluation Stats
Total Models7
Organizations2
Verified Results0
Self-Reported7
+
+
+
+
Benchmark Details
Max Score1
Language
en
+
+
+
+
Performance Overview
Score distribution and top performers
Score Distribution
7 models
Top Score
74.8%
Average Score
67.0%
High Performers (80%+)
0Top Organizations
#1Alibaba Cloud / Qwen Team
4 models
72.0%
#2Google
3 models
60.2%
+
+
+
+
Leaderboard
7 models ranked by performance on MathVista-Mini
| License | Links | ||||
|---|---|---|---|---|---|
| Jan 26, 2025 | tongyi-qianwen | 74.8% | |||
| Feb 28, 2025 | Apache 2.0 | 74.7% | |||
| Aug 29, 2024 | tongyi-qianwen | 70.5% | |||
| Jan 26, 2025 | Apache 2.0 | 68.2% | |||
| Mar 12, 2025 | Gemma | 67.6% | |||
| Mar 12, 2025 | Gemma | 62.9% | |||
| Mar 12, 2025 | Gemma | 50.0% |
