Comprehensive side-by-side LLM comparison
Mistral Small 3.1 24B Instruct leads with 15.6% higher average benchmark score. Mistral Small 3.1 24B Instruct supports multimodal inputs. Overall, Mistral Small 3.1 24B Instruct is the stronger choice for coding tasks.
Gemma 2 27B was developed as an open-source language model with 27 billion parameters, designed to provide researchers and developers with a capable, instruction-tuned model for experimentation and deployment. Built to democratize access to advanced language understanding, it combines strong performance with the flexibility of open-source licensing.
Mistral AI
Mistral Small 3.1 24B Instruct was developed as the instruction-tuned version of the 3.1 base model, designed to deliver improved instruction-following with refinements from the updated architecture. Built to serve diverse applications with enhanced reliability, it advances the Small model line's capabilities.
8 months newer

Gemma 2 27B
2024-06-27

Mistral Small 3.1 24B Instruct
Mistral AI
2025-03-17
Average performance across 5 common benchmarks

Gemma 2 27B

Mistral Small 3.1 24B Instruct
Available providers and their performance metrics

Gemma 2 27B

Mistral Small 3.1 24B Instruct

Gemma 2 27B

Mistral Small 3.1 24B Instruct