Comprehensive side-by-side LLM comparison
o4-mini leads with 36.1% higher average benchmark score. o4-mini offers 236.0K more tokens in context window than Mistral Small 3 24B Instruct. Mistral Small 3 24B Instruct is $5.29 cheaper per million tokens. o4-mini supports multimodal inputs. Overall, o4-mini is the stronger choice for coding tasks.
Mistral AI
Mistral Small 24B Instruct was created as the instruction-tuned version of the 24B base model, designed to follow user instructions reliably. Built to serve general-purpose applications requiring moderate capability, it balances performance with deployment practicality.
OpenAI
o4-mini was created as part of the next generation of OpenAI's reasoning models, designed to continue advancing the balance between analytical capability and operational efficiency. Built to bring cutting-edge reasoning techniques to applications requiring quick turnaround, it represents the evolution of compact reasoning-focused models.
2 months newer

Mistral Small 3 24B Instruct
Mistral AI
2025-01-30

o4-mini
OpenAI
2025-04-16
Cost per million tokens (USD)

Mistral Small 3 24B Instruct

o4-mini
Context window and performance specifications
Average performance across 1 common benchmarks

Mistral Small 3 24B Instruct

o4-mini
Mistral Small 3 24B Instruct
2023-10-01
o4-mini
2024-05-31
Available providers and their performance metrics

Mistral Small 3 24B Instruct
DeepInfra
Mistral AI


Mistral Small 3 24B Instruct

o4-mini

Mistral Small 3 24B Instruct

o4-mini
o4-mini
OpenAI