+
+
+
+
+
+
+
+
VS
VS
VS
VS
VS
VS
GPT-4o vs Mistral Small 3.1 24B Base
Comprehensive side-by-side LLM comparison
GPT-4o leads with 17.2% higher average benchmark score. Mistral Small 3.1 24B Base offers 111.6K more tokens in context window than GPT-4o. Mistral Small 3.1 24B Base is $12.10 cheaper per million tokens. Overall, GPT-4o is the stronger choice for coding tasks.
+
+
+
+
OpenAI
This updated version of GPT-4o was released with refinements to its multimodal capabilities and improved performance across text, vision, and audio tasks. Built to incorporate learnings from the initial GPT-4o deployment, it enhanced reliability and accuracy while maintaining the seamless cross-modal reasoning that defines the GPT-4o family.
+
+
+
+
Mistral AI
Mistral Small 3.1 24B Base represents an updated iteration of the 24B foundation model, developed with architectural refinements and improved training. Built to provide enhanced base capabilities for fine-tuning, it incorporates learnings from previous versions for better downstream performance.
7 months newer
GPT-4o
OpenAI
2024-08-06
Mistral Small 3.1 24B Base
Mistral AI
2025-03-17
+
+
+
+
+
+
+
+
+
+
+
+
Pricing Comparison
Cost per million tokens (USD)
+
+
+
+
GPT-4o
Input:$2.50
Output:$10.00
+
+
+
+
Mistral Small 3.1 24B Base
Input:$0.10
Output:$0.30($12.10 cheaper)
Performance Metrics
Context window and performance specifications
Average performance across 4 common benchmarks
+
+
+
+
GPT-4o
Average Score:75.7%(+17.2%)
+
+
+
+
Mistral Small 3.1 24B Base
Average Score:58.5%
Provider Availability & Performance
Available providers and their performance metrics
+
+
+
+
GPT-4o
2 providers
Azure
Throughput: 99 tok/s
Latency: 0.53ms
OpenAI
Throughput: 132 tok/s
Latency: 0.5ms
+
+
+
+
+
+
+
+
GPT-4o
Avg Score:75.7%(+17.2%)
Providers:2
+
+
+
+
Mistral Small 3.1 24B Base
Avg Score:58.5%
Providers:1