Cohere

Command R+

Zero-eval
#2Winogrande

by Cohere

+
+
+
+
About

Command R+ is a language model developed by Cohere. It achieves strong performance with an average score of 74.6% across 6 benchmarks. It excels particularly in HellaSwag (88.6%), Winogrande (85.4%), MMLU (75.7%). It supports a 256K token context window for handling large documents. The model is available through 2 API providers. Released in 2024, it represents Cohere's latest advancement in AI technology.

+
+
+
+
Pricing Range
Input (per 1M)$0.25 -$3.00
Output (per 1M)$1.00 -$15.00
Providers2
+
+
+
+
Timeline
AnnouncedAug 30, 2024
ReleasedAug 30, 2024
+
+
+
+
License & Family
License
CC BY-NC
Performance Overview
Performance metrics and category breakdown

Overall Performance

6 benchmarks
Average Score
74.6%
Best Score
88.6%
High Performers (80%+)
2

Performance Metrics

Max Context Window
256.0K
Avg Throughput
79.5 tok/s
Avg Latency
1ms
+
+
+
+
All Benchmark Results for Command R+
Complete list of benchmark scores with detailed information
HellaSwag
text
0.89
88.6%
Self-reported
Winogrande
text
0.85
85.4%
Self-reported
MMLU
text
0.76
75.7%
Self-reported
ARC-C
text
0.71
71.0%
Self-reported
GSM8k
text
0.71
70.7%
Self-reported
TruthfulQA
text
0.56
56.3%
Self-reported