Comprehensive side-by-side LLM comparison
Claude 3.5 Sonnet leads with 7.9% higher average benchmark score. Claude 3.5 Sonnet offers 368.0K more tokens in context window than Phi 4. Phi 4 is $17.79 cheaper per million tokens. Claude 3.5 Sonnet supports multimodal inputs. Claude 3.5 Sonnet is available on 3 providers. Overall, Claude 3.5 Sonnet is the stronger choice for coding tasks.
Anthropic
This upgraded version of Claude 3.5 Sonnet was released with significant improvements in coding and agentic tool use. Built to deliver enhanced performance in software engineering tasks, it brought substantial gains in reasoning and problem-solving while introducing the groundbreaking computer use capability in public beta, allowing it to interact with computer interfaces like a human.
Microsoft
Phi-4 was introduced as the fourth generation of Microsoft's small language model series, designed to push the boundaries of what compact models can achieve. Built with advanced training techniques and architectural improvements, it demonstrates continued progress in efficient, high-quality language models.
1 month newer

Claude 3.5 Sonnet
Anthropic
2024-10-22

Phi 4
Microsoft
2024-12-12
Cost per million tokens (USD)

Claude 3.5 Sonnet

Phi 4
Context window and performance specifications
Average performance across 7 common benchmarks

Claude 3.5 Sonnet

Phi 4
Phi 4
2024-06-01
Available providers and their performance metrics

Claude 3.5 Sonnet
Anthropic
Bedrock

Claude 3.5 Sonnet

Phi 4

Claude 3.5 Sonnet

Phi 4

Phi 4
DeepInfra