LLMs are better at judging research ideas than generating them; improving ideation systems may require external idea sources rather than just better individual model generation.
This paper introduces Re-Search, a benchmark that evaluates how LLMs explore research ideas through a Twenty Questions-style game. Given only a research problem, models must rediscover a paper's core idea by asking yes-or-no questions and receiving binary feedback.