+
+
+
+
+
+
+
+
VS
VS
VS
VS
VS
VS
Claude 3.5 Sonnet vs GPT-4o mini
Comprehensive side-by-side LLM comparison
Claude 3.5 Sonnet leads with 13.6% higher average benchmark score. Claude 3.5 Sonnet offers 255.6K more tokens in context window than GPT-4o mini. GPT-4o mini is $17.25 cheaper per million tokens. Claude 3.5 Sonnet is available on 3 providers. Overall, Claude 3.5 Sonnet is the stronger choice for coding tasks.
+
+
+
+
Anthropic
This upgraded version of Claude 3.5 Sonnet was released with significant improvements in coding and agentic tool use. Built to deliver enhanced performance in software engineering tasks, it brought substantial gains in reasoning and problem-solving while introducing the groundbreaking computer use capability in public beta, allowing it to interact with computer interfaces like a human.
+
+
+
+
OpenAI
GPT-4o Mini was created as a smaller, more efficient variant of GPT-4o, designed to bring multimodal capabilities to applications requiring faster response times and lower costs. Built to democratize access to advanced vision and text understanding, it enables developers to build sophisticated applications with reduced resource requirements.
3 months newer
GPT-4o mini
OpenAI
2024-07-18
Claude 3.5 Sonnet
Anthropic
2024-10-22
+
+
+
+
+
+
+
+
+
+
+
+
Pricing Comparison
Cost per million tokens (USD)
+
+
+
+
Claude 3.5 Sonnet
Input:$3.00
Output:$15.00
+
+
+
+
GPT-4o mini
Input:$0.15
Output:$0.60($17.25 cheaper)
Performance Metrics
Context window and performance specifications
Average performance across 9 common benchmarks
+
+
+
+
Claude 3.5 Sonnet
Average Score:77.0%(+13.6%)
+
+
+
+
GPT-4o mini
Average Score:63.5%
Performance comparison across key benchmark categories
+
+
+
+
Claude 3.5 Sonnet
Coding49.0%(+40.3%)
+
+
+
+
GPT-4o mini
Coding8.7%
+
+
+
+
Knowledge Cutoff
Training data recency comparison
GPT-4o mini
2023-10-01
More recent knowledge cutoff means awareness of newer technologies and frameworks
Provider Availability & Performance
Available providers and their performance metrics
+
+
+
+
Claude 3.5 Sonnet
3 providers
Anthropic
Throughput: 100 tok/s
Latency: 0.5ms
Bedrock
Throughput: 101 tok/s
Latency: 0.5ms
Throughput: 42 tok/s
Latency: 0.4ms
+
+
+
+
+
+
+
Claude 3.5 Sonnet
Avg Score:77.0%(+13.6%)
Providers:3
+
+
+
+
GPT-4o mini
Avg Score:63.5%
Providers:1