MM-Mind2Web

multimodal
+
+
+
+
About

A multimodal web navigation benchmark comprising 2,000 open-ended tasks spanning 137 websites across 31 domains. Each task includes HTML documents paired with webpage screenshots, action sequences, and complex web interactions.

+
+
+
+
Evaluation Stats
Total Models2
Organizations1
Verified Results0
Self-Reported2
+
+
+
+
Benchmark Details
Max Score1
Language
en
+
+
+
+
Performance Overview
Score distribution and top performers

Score Distribution

2 models
Top Score
63.7%
Average Score
62.2%
High Performers (80%+)
0

Top Organizations

#1Amazon
2 models
62.2%
+
+
+
+
Leaderboard
2 models ranked by performance on MM-Mind2Web
LicenseLinks
Nov 20, 2024
Proprietary
63.7%
Nov 20, 2024
Proprietary
60.7%
+
+
+
+
Resources