+
+
+
+
+
+
+
+
VS
VS
VS
VS
VS
VS
GPT OSS 120B vs Mistral Small 3 24B Base
Comprehensive side-by-side LLM comparison
GPT OSS 120B leads with 27.5% higher average benchmark score. Mistral Small 3 24B Base supports multimodal inputs. GPT OSS 120B is available on 5 providers. Overall, GPT OSS 120B is the stronger choice for coding tasks.
+
+
+
+
OpenAI
GPT-OSS 120B was developed as an open-source model release from OpenAI, designed to provide the research and developer community with access to a capable language model. Built with 120 billion parameters, it enables experimentation, fine-tuning, and deployment in contexts where open-source licensing and transparency are valued.
+
+
+
+
Mistral AI
Mistral Small 24B Base was developed as a 24-billion-parameter foundation model, designed to serve as a base for fine-tuning and customization. Built to provide a strong starting point for domain-specific applications, it represents an intermediate-scale option in Mistral's model lineup.
6 months newer
Mistral Small 3 24B Base
Mistral AI
2025-01-30
GPT OSS 120B
OpenAI
2025-08-05
+
+
+
+
+
+
+
+
+
+
+
+
Performance Metrics
Context window and performance specifications
Average performance across 2 common benchmarks
+
+
+
+
GPT OSS 120B
Average Score:85.0%(+27.5%)
+
+
+
+
Mistral Small 3 24B Base
Average Score:57.6%
+
+
+
+
Knowledge Cutoff
Training data recency comparison
Mistral Small 3 24B Base
2023-10-01
More recent knowledge cutoff means awareness of newer technologies and frameworks
Provider Availability & Performance
Available providers and their performance metrics
+
+
+
+
GPT OSS 120B
5 providers
DeepInfra
Groq
Throughput: 500 tok/s
Latency: 0.5ms
Novita
OpenAI
Throughput: 115 tok/s
Latency: 5.2ms
ZeroEval
Throughput: 500 tok/s
Latency: 0.5ms
+
+
+
+
+
GPT OSS 120B
Avg Score:85.0%(+27.5%)
Providers:5
+
+
+
+
Mistral Small 3 24B Base
Avg Score:57.6%
Providers:0