Comprehensive side-by-side LLM comparison
o4-mini leads with 28.9% higher average benchmark score. Overall, o4-mini is the stronger choice for coding tasks.
Mistral AI
Mistral Small 3.1 24B Instruct was developed as the instruction-tuned version of the 3.1 base model, designed to deliver improved instruction-following with refinements from the updated architecture. Built to serve diverse applications with enhanced reliability, it advances the Small model line's capabilities.
OpenAI
o4-mini was created as part of the next generation of OpenAI's reasoning models, designed to continue advancing the balance between analytical capability and operational efficiency. Built to bring cutting-edge reasoning techniques to applications requiring quick turnaround, it represents the evolution of compact reasoning-focused models.
1 month newer

Mistral Small 3.1 24B Instruct
Mistral AI
2025-03-17

o4-mini
OpenAI
2025-04-16
Context window and performance specifications
Average performance across 2 common benchmarks

Mistral Small 3.1 24B Instruct

o4-mini
o4-mini
2024-05-31
Available providers and their performance metrics

Mistral Small 3.1 24B Instruct

o4-mini
OpenAI

Mistral Small 3.1 24B Instruct

o4-mini

Mistral Small 3.1 24B Instruct

o4-mini