Comprehensive side-by-side LLM comparison
Devstral Medium leads with 12.6% higher average benchmark score. Claude 3.5 Sonnet offers 144.0K more tokens in context window than Devstral Medium. Devstral Medium is $15.60 cheaper per million tokens. Claude 3.5 Sonnet supports multimodal inputs. Claude 3.5 Sonnet is available on 3 providers. Overall, Devstral Medium is the stronger choice for coding tasks.
Anthropic
This upgraded version of Claude 3.5 Sonnet was released with significant improvements in coding and agentic tool use. Built to deliver enhanced performance in software engineering tasks, it brought substantial gains in reasoning and problem-solving while introducing the groundbreaking computer use capability in public beta, allowing it to interact with computer interfaces like a human.
Mistral AI
Devstral Medium was created as a development-focused model, designed to assist with software engineering workflows and developer-centric tasks. Built to provide balanced capability for coding, debugging, and technical documentation, it serves as a versatile tool for professional development environments.
8 months newer

Claude 3.5 Sonnet
Anthropic
2024-10-22

Devstral Medium
Mistral AI
2025-07-10
Cost per million tokens (USD)

Claude 3.5 Sonnet

Devstral Medium
Context window and performance specifications
Average performance across 1 common benchmarks

Claude 3.5 Sonnet

Devstral Medium
Performance comparison across key benchmark categories

Claude 3.5 Sonnet

Devstral Medium
Available providers and their performance metrics

Claude 3.5 Sonnet
Anthropic
Bedrock

Claude 3.5 Sonnet

Devstral Medium

Claude 3.5 Sonnet

Devstral Medium

Devstral Medium
Mistral AI