Comprehensive side-by-side LLM comparison
o3 leads with 7.5% higher average benchmark score. o3 offers 44.0K more tokens in context window than Devstral Medium. Devstral Medium is $7.60 cheaper per million tokens. o3 supports multimodal inputs. Overall, o3 is the stronger choice for coding tasks.
Mistral AI
Devstral Medium was created as a development-focused model, designed to assist with software engineering workflows and developer-centric tasks. Built to provide balanced capability for coding, debugging, and technical documentation, it serves as a versatile tool for professional development environments.
OpenAI
o3 represents the next generation in OpenAI's reasoning model series, developed to advance the capabilities of deliberate, step-by-step problem solving. Built to handle increasingly complex challenges across mathematics, science, and coding, it continues the evolution of reasoning-focused AI with improved analytical depth and accuracy.
2 months newer

o3
OpenAI
2025-04-16

Devstral Medium
Mistral AI
2025-07-10
Cost per million tokens (USD)

Devstral Medium

o3
Context window and performance specifications
Average performance across 1 common benchmarks

Devstral Medium

o3
Performance comparison across key benchmark categories

Devstral Medium

o3
o3
2024-05-31
Available providers and their performance metrics

Devstral Medium
Mistral AI

o3

Devstral Medium

o3

Devstral Medium

o3
OpenAI