Comprehensive side-by-side LLM comparison
GPT-4o mini leads with 21.6% higher average benchmark score. Phi-3.5-mini-instruct offers 111.6K more tokens in context window than GPT-4o mini. Phi-3.5-mini-instruct is $0.55 cheaper per million tokens. GPT-4o mini supports multimodal inputs. Overall, GPT-4o mini is the stronger choice for coding tasks.
OpenAI
GPT-4o Mini was created as a smaller, more efficient variant of GPT-4o, designed to bring multimodal capabilities to applications requiring faster response times and lower costs. Built to democratize access to advanced vision and text understanding, it enables developers to build sophisticated applications with reduced resource requirements.
Microsoft
Phi-3.5 Mini was developed by Microsoft as a small language model designed to deliver impressive performance despite its compact size. Built with efficiency in mind, it demonstrates that capable language understanding and generation can be achieved with fewer parameters, making AI more accessible for edge and resource-constrained deployments.
1 month newer

GPT-4o mini
OpenAI
2024-07-18

Phi-3.5-mini-instruct
Microsoft
2024-08-23
Cost per million tokens (USD)

GPT-4o mini

Phi-3.5-mini-instruct
Context window and performance specifications
Average performance across 5 common benchmarks

GPT-4o mini

Phi-3.5-mini-instruct
GPT-4o mini
2023-10-01
Available providers and their performance metrics

GPT-4o mini
Azure

Phi-3.5-mini-instruct

GPT-4o mini

Phi-3.5-mini-instruct

GPT-4o mini

Phi-3.5-mini-instruct
Azure