Comprehensive side-by-side LLM comparison
Mistral Small 3.1 24B Instruct leads with 1.7% higher average benchmark score. Both models have their strengths depending on your specific coding needs.
Google DeepMind
Gemma 3 12B is a 12-billion-parameter open-weight model from Google DeepMind, released in March 2025 as part of the Gemma 3 series designed to bring multimodal reasoning to accessible hardware. The model supports both text and image inputs across a 128K token context window, extending the vision capabilities that defined the Gemma 3 generation compared to earlier text-only Gemma releases. It became widely adopted for domain-specific fine-tuning in research and enterprise settings where full multimodal capability was needed without the infrastructure demands of larger frontier models.
Mistral AI
Mistral Small 3.1 is a 24-billion-parameter multimodal model from Mistral AI, released in March 2025 as an update to Mistral Small 3 that added vision understanding and expanded the context window from 32K to 128K tokens. The model accepts both text and image inputs, broadening its applicability to document analysis, image-grounded reasoning, and mixed-media workflows without requiring an increase in parameter count. Released under Apache 2.0, it continued Mistral's pattern of incremental capability gains delivered in compact, practically deployable open-weight packages.
5 days newer

Gemma 3 12B
Google DeepMind
2025-03-12

Mistral Small 3.1 24B Instruct
Mistral AI
2025-03-17
Average performance across 1 common benchmarks
Gemma 3 12B
Mistral Small 3.1 24B Instruct
Performance comparison across key benchmark categories
Gemma 3 12B
Mistral Small 3.1 24B Instruct
Available providers and their performance metrics
Gemma 3 12B
Mistral Small 3.1 24B Instruct
Gemma 3 12B
Mistral Small 3.1 24B Instruct