Comprehensive side-by-side LLM comparison
Phi 4 leads with 12.3% higher average benchmark score. Mistral Small 3.1 24B Base offers 224.0K more tokens in context window than Phi 4. Both models have similar pricing. Mistral Small 3.1 24B Base supports multimodal inputs. Overall, Phi 4 is the stronger choice for coding tasks.
Mistral AI
Mistral Small 3.1 24B Base represents an updated iteration of the 24B foundation model, developed with architectural refinements and improved training. Built to provide enhanced base capabilities for fine-tuning, it incorporates learnings from previous versions for better downstream performance.
Microsoft
Phi-4 was introduced as the fourth generation of Microsoft's small language model series, designed to push the boundaries of what compact models can achieve. Built with advanced training techniques and architectural improvements, it demonstrates continued progress in efficient, high-quality language models.
3 months newer

Phi 4
Microsoft
2024-12-12

Mistral Small 3.1 24B Base
Mistral AI
2025-03-17
Cost per million tokens (USD)

Mistral Small 3.1 24B Base

Phi 4
Context window and performance specifications
Average performance across 3 common benchmarks

Mistral Small 3.1 24B Base

Phi 4
Phi 4
2024-06-01
Available providers and their performance metrics

Mistral Small 3.1 24B Base
Mistral AI

Phi 4

Mistral Small 3.1 24B Base

Phi 4

Mistral Small 3.1 24B Base

Phi 4
DeepInfra