Comprehensive side-by-side LLM comparison
Claude Sonnet 4 leads with 26.5% higher average benchmark score. Claude Sonnet 4 offers 72.0K more tokens in context window than Mistral Small 3.1 24B Base. Mistral Small 3.1 24B Base is $17.60 cheaper per million tokens. Claude Sonnet 4 is available on 4 providers. Overall, Claude Sonnet 4 is the stronger choice for coding tasks.
Anthropic
Claude Sonnet 4 was created as the balanced offering in the Claude 4 family, designed to provide strong intelligence with practical speed and cost efficiency. Built to serve as a versatile workhorse for diverse applications, it balances advanced capabilities with operational considerations for everyday enterprise and consumer use.
Mistral AI
Mistral Small 3.1 24B Base represents an updated iteration of the 24B foundation model, developed with architectural refinements and improved training. Built to provide enhanced base capabilities for fine-tuning, it incorporates learnings from previous versions for better downstream performance.
2 months newer

Mistral Small 3.1 24B Base
Mistral AI
2025-03-17

Claude Sonnet 4
Anthropic
2025-05-22
Cost per million tokens (USD)

Claude Sonnet 4

Mistral Small 3.1 24B Base
Context window and performance specifications
Average performance across 2 common benchmarks

Claude Sonnet 4

Mistral Small 3.1 24B Base
Available providers and their performance metrics

Claude Sonnet 4
Anthropic
Bedrock
ZeroEval

Claude Sonnet 4

Mistral Small 3.1 24B Base

Claude Sonnet 4

Mistral Small 3.1 24B Base

Mistral Small 3.1 24B Base
Mistral AI