Llama-3.1 Nemotron Ultra 253B vs Step-3.5-Flash

Llama-3.1 Nemotron Ultra 253B

NVIDIA

Llama-3.1-Nemotron-Ultra-253B-v1 is a 253-billion-parameter model from NVIDIA, derived from Meta's Llama 3.1 405B using neural architecture search (NAS) compression combined with NVIDIA's Nemotron post-training pipeline, which recovers and exceeds the base model's capability after structural compression. Released in April 2025, it supports toggling between a standard instruction mode and an extended reasoning mode via system prompt, allowing the same model to handle both rapid responses and deliberate chain-of-thought tasks. It is the flagship of the Nemotron family, available open-weight on HuggingFace and through NVIDIA NIM for enterprise inference.

StepFun

Step-3.5-Flash, released by StepFun on February 2, 2026, is a Mixture-of-Experts large language model with 197 billion total parameters and approximately 11 billion active parameters per inference. It features a 256K token context window using a 3:1 sliding-window-to-full-attention ratio, processing 100–350 tokens per second. Step-3.5-Flash targets agentic tasks, coding workflows, and open-source deployments requiring frontier reasoning capabilities with efficient inference, under an Apache 2.0 license.