Comprehensive side-by-side LLM comparison
Claude 3 Haiku leads with 8.8% higher average benchmark score. Claude 3 Haiku supports multimodal inputs. Claude 3 Haiku is available on 3 providers. Overall, Claude 3 Haiku is the stronger choice for coding tasks.
Anthropic
Claude 3 Haiku was created as the fastest and most affordable model in its intelligence class, processing 21K tokens per second for prompts under 32K tokens. Built for enterprise workloads requiring quick analysis of large datasets, it combines state-of-the-art vision capabilities with strong performance on industry benchmarks while prioritizing speed, affordability, and enterprise-grade security.
Gemma 2 27B was developed as an open-source language model with 27 billion parameters, designed to provide researchers and developers with a capable, instruction-tuned model for experimentation and deployment. Built to democratize access to advanced language understanding, it combines strong performance with the flexibility of open-source licensing.
3 months newer

Claude 3 Haiku
Anthropic
2024-03-13

Gemma 2 27B
2024-06-27
Context window and performance specifications
Average performance across 6 common benchmarks

Claude 3 Haiku

Gemma 2 27B
Available providers and their performance metrics

Claude 3 Haiku
Anthropic
Bedrock

Claude 3 Haiku

Gemma 2 27B

Claude 3 Haiku

Gemma 2 27B

Gemma 2 27B