Comprehensive side-by-side LLM comparison
Devstral Small 1.1 leads with 20.4% higher average benchmark score. Devstral Small 1.1 offers 111.6K more tokens in context window than GPT-4o. Devstral Small 1.1 is $12.10 cheaper per million tokens. GPT-4o supports multimodal inputs. Overall, Devstral Small 1.1 is the stronger choice for coding tasks.
Mistral AI
Devstral Small was developed as a more efficient development-focused model, designed to bring software engineering assistance to resource-conscious deployments. Built to provide coding capabilities with reduced computational requirements, it enables developer tools in environments where efficiency is paramount.
OpenAI
This updated version of GPT-4o was released with refinements to its multimodal capabilities and improved performance across text, vision, and audio tasks. Built to incorporate learnings from the initial GPT-4o deployment, it enhanced reliability and accuracy while maintaining the seamless cross-modal reasoning that defines the GPT-4o family.
11 months newer

GPT-4o
OpenAI
2024-08-06

Devstral Small 1.1
Mistral AI
2025-07-11
Cost per million tokens (USD)

Devstral Small 1.1

GPT-4o
Context window and performance specifications
Average performance across 1 common benchmarks

Devstral Small 1.1

GPT-4o
Performance comparison across key benchmark categories

Devstral Small 1.1

GPT-4o
Available providers and their performance metrics

Devstral Small 1.1
Mistral AI

GPT-4o

Devstral Small 1.1

GPT-4o

Devstral Small 1.1

GPT-4o
Azure
OpenAI