Comprehensive side-by-side LLM comparison
GPT-4o mini leads with 11.6% higher average benchmark score. Claude 3 Haiku offers 255.6K more tokens in context window than GPT-4o mini. GPT-4o mini is $0.75 cheaper per million tokens. Claude 3 Haiku is available on 3 providers. Overall, GPT-4o mini is the stronger choice for coding tasks.
Anthropic
Claude 3 Haiku was created as the fastest and most affordable model in its intelligence class, processing 21K tokens per second for prompts under 32K tokens. Built for enterprise workloads requiring quick analysis of large datasets, it combines state-of-the-art vision capabilities with strong performance on industry benchmarks while prioritizing speed, affordability, and enterprise-grade security.
OpenAI
GPT-4o Mini was created as a smaller, more efficient variant of GPT-4o, designed to bring multimodal capabilities to applications requiring faster response times and lower costs. Built to democratize access to advanced vision and text understanding, it enables developers to build sophisticated applications with reduced resource requirements.
4 months newer

Claude 3 Haiku
Anthropic
2024-03-13

GPT-4o mini
OpenAI
2024-07-18
Cost per million tokens (USD)

Claude 3 Haiku

GPT-4o mini
Context window and performance specifications
Average performance across 6 common benchmarks

Claude 3 Haiku

GPT-4o mini
GPT-4o mini
2023-10-01
Available providers and their performance metrics

Claude 3 Haiku
Anthropic
Bedrock

Claude 3 Haiku

GPT-4o mini

Claude 3 Haiku

GPT-4o mini

GPT-4o mini
Azure