Comprehensive side-by-side LLM comparison
GPT-4 leads with 13.5% higher average benchmark score. GPT-4 supports multimodal inputs. GPT-4 is available on 2 providers. Overall, GPT-4 is the stronger choice for coding tasks.
Gemma 2 9B was created as a more compact open-source model, designed to deliver capable performance with reduced computational requirements. Built with 9 billion parameters and instruction tuning, it serves applications where efficiency and accessibility are valued alongside the benefits of open-source availability.
OpenAI
GPT-4 was created as a large multimodal model capable of accepting image and text inputs while producing text outputs. Developed to exhibit human-level performance on various professional and academic benchmarks, it marked a significant advancement in reliability, creativity, and handling of nuanced instructions compared to its predecessors.
1 year newer

GPT-4
OpenAI
2023-06-13

Gemma 2 9B
2024-06-27
Context window and performance specifications
Average performance across 5 common benchmarks

Gemma 2 9B

GPT-4
GPT-4
2022-12-31
Available providers and their performance metrics

Gemma 2 9B

GPT-4
Azure

Gemma 2 9B

GPT-4

Gemma 2 9B

GPT-4
OpenAI