Mistral AI

Codestral-22B

#1HumanEvalFIM-Average
#1Spider
#1HumanEval-Average
+2 more

by Mistral AI

+
+
+
+
About

Codestral-22B is a language model developed by Mistral AI. It achieves strong performance with an average score of 65.9% across 7 benchmarks. It excels particularly in HumanEvalFIM-Average (91.6%), HumanEval (81.1%), MBPP (78.2%). Released in 2024, it represents Mistral AI's latest advancement in AI technology.

+
+
+
+
Timeline
AnnouncedMay 29, 2024
ReleasedMay 29, 2024
+
+
+
+
License & Family
License
MNPL-0.1
Performance Overview
Performance metrics and category breakdown

Overall Performance

7 benchmarks
Average Score
65.9%
Best Score
91.6%
High Performers (80%+)
2
+
+
+
+
All Benchmark Results for Codestral-22B
Complete list of benchmark scores with detailed information
HumanEvalFIM-Average
text
0.92
91.6%
Self-reported
HumanEval
text
0.81
81.1%
Self-reported
MBPP
text
0.78
78.2%
Self-reported
Spider
text
0.64
63.5%
Self-reported
HumanEval-Average
text
0.61
61.5%
Self-reported
CruxEval-O
text
0.51
51.3%
Self-reported
RepoBench
text
0.34
34.0%
Self-reported