Comprehensive side-by-side LLM comparison
Codestral 22B leads with 3.8% higher average benchmark score. Gemma 3 27B supports multimodal inputs. Both models have their strengths depending on your specific coding needs.
Mistral AI
Codestral is a 22-billion-parameter code-specialized model from Mistral AI, released in May 2024 as the company's first dedicated coding model, trained with focus on fill-in-the-middle (FIM) completion, code generation, and repair across 80+ programming languages. Unlike Mistral's general-purpose Apache 2.0 models, Codestral was released under a separate non-production research license, reflecting its positioning as a professional coding tool requiring commercial API access for production deployment. Its FIM support made it particularly valued for IDE integrations and code completion tools that need to insert code within existing contexts rather than only appending to the end.
Google DeepMind
Gemma 3 27B is a 27-billion-parameter open-weight model from Google DeepMind, released in March 2025 alongside the Gemma 3 12B as the higher-capability variant in the series, built with native vision-language support for text and image inputs across a 128K token context window. Among the Gemma 3 releases, the 27B delivered the strongest results on instruction-following and knowledge-intensive reasoning tasks, making it the preferred option for developers needing greater accuracy from a self-hostable model. Its open-weight availability under a permissive license made it a common starting point for vision-language fine-tuning projects.
9 months newer

Codestral 22B
Mistral AI
2024-05-29

Gemma 3 27B
Google DeepMind
2025-03-12
Average performance across 1 common benchmarks
Codestral 22B
Gemma 3 27B
Performance comparison across key benchmark categories
Codestral 22B
Gemma 3 27B
Available providers and their performance metrics
Codestral 22B
Gemma 3 27B
Codestral 22B
Gemma 3 27B