Comprehensive side-by-side LLM comparison
Claude Sonnet 4 leads with 28.9% higher average benchmark score. Gemini 1.5 Flash 8B offers 728.8K more tokens in context window than Claude Sonnet 4. Gemini 1.5 Flash 8B is $17.63 cheaper per million tokens. Claude Sonnet 4 is available on 4 providers. Overall, Claude Sonnet 4 is the stronger choice for coding tasks.
Anthropic
Claude Sonnet 4 was created as the balanced offering in the Claude 4 family, designed to provide strong intelligence with practical speed and cost efficiency. Built to serve as a versatile workhorse for diverse applications, it balances advanced capabilities with operational considerations for everyday enterprise and consumer use.
Gemini 1.5 Flash 8B was developed as an ultra-compact variant of Gemini 1.5 Flash, designed to deliver multimodal capabilities with minimal resource requirements. Built for deployment scenarios where efficiency is critical, it provides a lightweight option for applications requiring fast, cost-effective AI processing.
1 year newer

Gemini 1.5 Flash 8B
2024-03-15

Claude Sonnet 4
Anthropic
2025-05-22
Cost per million tokens (USD)

Claude Sonnet 4

Gemini 1.5 Flash 8B
Context window and performance specifications
Average performance across 2 common benchmarks

Claude Sonnet 4

Gemini 1.5 Flash 8B
Gemini 1.5 Flash 8B
2024-10-01
Available providers and their performance metrics

Claude Sonnet 4
Anthropic
Bedrock
ZeroEval

Claude Sonnet 4

Gemini 1.5 Flash 8B

Claude Sonnet 4

Gemini 1.5 Flash 8B

Gemini 1.5 Flash 8B