+
+
+
+
+
+
+
+
VS
VS
VS
VS
VS
VS
Claude 3.5 Haiku vs GPT-4o mini
Comprehensive side-by-side LLM comparison
Claude 3.5 Haiku leads with 5.9% higher average benchmark score. Claude 3.5 Haiku offers 255.6K more tokens in context window than GPT-4o mini. GPT-4o mini is $4.05 cheaper per million tokens. GPT-4o mini supports multimodal inputs. Claude 3.5 Haiku is available on 3 providers. Overall, Claude 3.5 Haiku is the stronger choice for coding tasks.
+
+
+
+
Anthropic
Claude 3.5 Haiku was developed as the next generation of Anthropic's fastest model, offering similar speed to Claude 3 Haiku while surpassing Claude 3 Opus on many intelligence benchmarks. Built with low latency, improved instruction following, and accurate tool use, it serves user-facing products, specialized sub-agent tasks, and data-heavy applications.
+
+
+
+
OpenAI
GPT-4o Mini was created as a smaller, more efficient variant of GPT-4o, designed to bring multimodal capabilities to applications requiring faster response times and lower costs. Built to democratize access to advanced vision and text understanding, it enables developers to build sophisticated applications with reduced resource requirements.
3 months newer
GPT-4o mini
OpenAI
2024-07-18
Claude 3.5 Haiku
Anthropic
2024-10-22
+
+
+
+
+
+
+
+
+
+
+
+
Pricing Comparison
Cost per million tokens (USD)
+
+
+
+
Claude 3.5 Haiku
Input:$0.80
Output:$4.00
+
+
+
+
GPT-4o mini
Input:$0.15
Output:$0.60($4.05 cheaper)
Performance Metrics
Context window and performance specifications
Average performance across 6 common benchmarks
+
+
+
+
Claude 3.5 Haiku
Average Score:68.1%(+5.9%)
+
+
+
+
GPT-4o mini
Average Score:62.2%
Performance comparison across key benchmark categories
+
+
+
+
Claude 3.5 Haiku
Coding40.6%(+31.9%)
+
+
+
+
GPT-4o mini
Coding8.7%
+
+
+
+
Knowledge Cutoff
Training data recency comparison
GPT-4o mini
2023-10-01
More recent knowledge cutoff means awareness of newer technologies and frameworks
Provider Availability & Performance
Available providers and their performance metrics
+
+
+
+
Claude 3.5 Haiku
3 providers
Anthropic
Throughput: 100 tok/s
Latency: 0.3ms
Bedrock
Throughput: 104 tok/s
Latency: 0.5ms
Throughput: 42 tok/s
Latency: 0.4ms
+
+
+
+
+
+
+
Claude 3.5 Haiku
Avg Score:68.1%(+5.9%)
Providers:3
+
+
+
+
GPT-4o mini
Avg Score:62.2%
Providers:1