Comprehensive side-by-side LLM comparison
Gemma 3 27B leads with 5.6% higher average benchmark score. Claude 3.5 Haiku offers 137.9K more tokens in context window than Gemma 3 27B. Gemma 3 27B is $4.50 cheaper per million tokens. Gemma 3 27B supports multimodal inputs. Overall, Gemma 3 27B is the stronger choice for coding tasks.
Anthropic
Claude 3.5 Haiku was developed as the next generation of Anthropic's fastest model, offering similar speed to Claude 3 Haiku while surpassing Claude 3 Opus on many intelligence benchmarks. Built with low latency, improved instruction following, and accurate tool use, it serves user-facing products, specialized sub-agent tasks, and data-heavy applications.
Gemma 3 27B represents the largest variant in the Gemma 3 family, developed to provide flagship-level open-source capabilities. Built with advanced training methodologies and 27 billion parameters, it offers researchers and developers access to powerful language understanding without proprietary restrictions.
4 months newer

Claude 3.5 Haiku
Anthropic
2024-10-22

Gemma 3 27B
2025-03-12
Cost per million tokens (USD)

Claude 3.5 Haiku

Gemma 3 27B
Context window and performance specifications
Average performance across 4 common benchmarks

Claude 3.5 Haiku

Gemma 3 27B
Available providers and their performance metrics

Claude 3.5 Haiku
Anthropic
Bedrock

Claude 3.5 Haiku

Gemma 3 27B

Claude 3.5 Haiku

Gemma 3 27B

Gemma 3 27B
DeepInfra
Novita