+
+
+
+
+
+
+
+
VS
VS
VS
VS
VS
VS
Claude 3.5 Sonnet vs GPT-4o mini
Comprehensive side-by-side LLM comparison
Claude 3.5 Sonnet leads with 15.5% higher average benchmark score. Claude 3.5 Sonnet offers 255.6K more tokens in context window than GPT-4o mini. GPT-4o mini is $17.25 cheaper per million tokens. Overall, Claude 3.5 Sonnet is the stronger choice for coding tasks.
+
+
+
+
Anthropic
Claude 3.5 Sonnet is a multimodal language model developed by Anthropic. This model demonstrates exceptional performance with an average score of 84.1% across 9 benchmarks. It excels particularly in GSM8k (96.4%), BIG-Bench Hard (93.1%), HumanEval (92.0%). It supports a 400K token context window for handling large documents. The model is available through 2 API providers. As a multimodal model, it can process and understand text, images, and other input formats seamlessly. Released in 2024, it represents Anthropic's latest advancement in AI technology.
+
+
+
+
OpenAI
GPT-4o mini is a multimodal language model developed by OpenAI. It achieves strong performance with an average score of 63.5% across 9 benchmarks. It excels particularly in HumanEval (87.2%), MGSM (87.0%), MMLU (82.0%). It supports a 144K token context window for handling large documents. The model is available through 1 API provider. As a multimodal model, it can process and understand text, images, and other input formats seamlessly. Released in 2024, it represents OpenAI's latest advancement in AI technology.
27 days newer
Claude 3.5 Sonnet
Anthropic
2024-06-21
GPT-4o mini
OpenAI
2024-07-18
Pricing Comparison
Cost per million tokens (USD)
+
+
+
+
Claude 3.5 Sonnet
Input:$3.00
Output:$15.00
+
+
+
+
GPT-4o mini
Input:$0.15
Output:$0.60($17.25 cheaper)
Performance Metrics
Context window and performance specifications
Average performance across 12 common benchmarks
+
+
+
+
Claude 3.5 Sonnet
Average Score:63.1%(+15.5%)
+
+
+
+
GPT-4o mini
Average Score:47.6%
+
+
+
+
Knowledge Cutoff
Training data recency comparison
GPT-4o mini
2023-10-01
More recent knowledge cutoff means awareness of newer technologies and frameworks
Provider Availability & Performance
Available providers and their performance metrics
+
+
+
+
Claude 3.5 Sonnet
2 providers
Bedrock
Throughput: 101 tok/s
Latency: 0.5ms
Throughput: 42 tok/s
Latency: 0.4ms
+
+
+
+
+
+
+
+
Claude 3.5 Sonnet
Avg Score:63.1%(+15.5%)
Providers:2
+
+
+
+
GPT-4o mini
Avg Score:47.6%
Providers:1