BoolQ

BoolQ is a question answering benchmark for yes/no questions containing 15,942 naturally occurring examples that test reading comprehension and natural language inference. These questions are unprompted and unconstrained, reflecting real-world information-seeking scenarios. The benchmark challenges models to perform binary classification on complex questions requiring deep text understanding, making it similar to existing natural language inference tasks but with practical, realistic queries.