OpenAI

GPT-4o

Multimodal
Zero-eval

by OpenAI

+
+
+
+
About

GPT-4o is a multimodal language model developed by OpenAI. It achieves strong performance with an average score of 77.4% across 8 benchmarks. It excels particularly in MGSM (90.5%), HumanEval (90.2%), MMLU (88.7%). It supports a 132K token context window for handling large documents. The model is available through 2 API providers. As a multimodal model, it can process and understand text, images, and other input formats seamlessly. Released in 2024, it represents OpenAI's latest advancement in AI technology.

+
+
+
+
Pricing Range
Input (per 1M)$2.50 -$2.50
Output (per 1M)$10.00 -$10.00
Providers2
+
+
+
+
Timeline
AnnouncedMay 13, 2024
ReleasedMay 13, 2024
+
+
+
+
Specifications
Capabilities
Multimodal
+
+
+
+
License & Family
License
Proprietary
Performance Overview
Performance metrics and category breakdown

Overall Performance

8 benchmarks
Average Score
77.4%
Best Score
90.5%
High Performers (80%+)
4

Performance Metrics

Max Context Window
132.1K
Avg Throughput
96.0 tok/s
Avg Latency
1ms
+
+
+
+
All Benchmark Results for GPT-4o
Complete list of benchmark scores with detailed information
MGSM
text
0.91
90.5%
Self-reported
HumanEval
text
0.90
90.2%
Self-reported
MMLU
text
0.89
88.7%
Self-reported
DROP
text
0.83
83.4%
Self-reported
MATH
text
0.77
76.6%
Self-reported
MMLU-Pro
text
0.73
72.6%
Self-reported
MathVista
multimodal
0.64
63.8%
Self-reported
GPQA
text
0.54
53.6%
Self-reported