Comprehensive side-by-side LLM comparison
Grok 4 leads with 32.5% higher average benchmark score. Grok 4 offers 70.4K more tokens in context window than Claude 3.5 Sonnet. Claude 3.5 Sonnet is $12.00 cheaper per million tokens. Claude 3.5 Sonnet is available on 3 providers. Overall, Grok 4 is the stronger choice for coding tasks.
Anthropic
Claude 3.5 Sonnet, updated by Anthropic in October 2024 (originally released June 2024), is a large language model from the Claude 3.5 family that delivered strong performance in coding, reasoning, and instruction-following at its release. It supports a 200K token context window, 8K maximum output tokens, and native image understanding including screenshot analysis and document comprehension. Claude 3.5 Sonnet targets general-purpose development tasks, document analysis, and applications requiring reliable instruction following with visual input support.
xAI
Grok 4, released by xAI on July 10, 2025, is a large language model featuring first-principles reasoning and comprehensive multimodal support. It features a 260K token context window and demonstrated strong performance on advanced reasoning and coding benchmarks. Grok 4 targets complex multi-step reasoning tasks, scientific analysis, and agentic workflows via the xAI API.
8 months newer

Claude 3.5 Sonnet
Anthropic
2024-10-22

Grok 4
xAI
2025-07-10
Cost per million tokens (USD)
Claude 3.5 Sonnet
Grok 4
Context window and performance specifications
Average performance across 1 common benchmarks
Claude 3.5 Sonnet
Grok 4
Performance comparison across key benchmark categories
Claude 3.5 Sonnet
Grok 4
Claude 3.5 Sonnet
2024-04
Available providers and their performance metrics
Claude 3.5 Sonnet
Anthropic
AWS Bedrock
Google Cloud Vertex AI
Grok 4
Claude 3.5 Sonnet
Grok 4
Claude 3.5 Sonnet
Grok 4
xAI