LiveBrowseComp: Are Search Agents Searching, or Just Verifying What They Already Know?

要約

Are LLM-based search agents genuinely searching, or using the web to verify what they already know? We study this question on BrowseComp with three diagnostics. Our analysis reveals Intrinsic Knowledge Dependence (IKD): even with tool access, agents often rely on intrinsic knowledge — information e…