PopQA

PopQA is an open-domain question-answering benchmark featuring 14,000 QA pairs with fine-grained entity popularity information from Wikidata and Wikipedia page views. This unique benchmark evaluates how AI models' factual knowledge correlates with entity popularity, testing both knowledge retrieval capabilities and potential biases toward popular versus obscure entities in factual question-answering tasks.