Comprehensive side-by-side LLM comparison
Devstral Medium leads with 52.9% higher average benchmark score. Devstral Medium offers 111.6K more tokens in context window than GPT-4o mini. GPT-4o mini is $1.65 cheaper per million tokens. GPT-4o mini supports multimodal inputs. Overall, Devstral Medium is the stronger choice for coding tasks.
Mistral AI
Devstral Medium was created as a development-focused model, designed to assist with software engineering workflows and developer-centric tasks. Built to provide balanced capability for coding, debugging, and technical documentation, it serves as a versatile tool for professional development environments.
OpenAI
GPT-4o Mini was created as a smaller, more efficient variant of GPT-4o, designed to bring multimodal capabilities to applications requiring faster response times and lower costs. Built to democratize access to advanced vision and text understanding, it enables developers to build sophisticated applications with reduced resource requirements.
11 months newer

GPT-4o mini
OpenAI
2024-07-18

Devstral Medium
Mistral AI
2025-07-10
Cost per million tokens (USD)

Devstral Medium

GPT-4o mini
Context window and performance specifications
Average performance across 1 common benchmarks

Devstral Medium

GPT-4o mini
Performance comparison across key benchmark categories

Devstral Medium

GPT-4o mini
GPT-4o mini
2023-10-01
Available providers and their performance metrics

Devstral Medium
Mistral AI

GPT-4o mini

Devstral Medium

GPT-4o mini

Devstral Medium

GPT-4o mini
Azure