LLMs can generate reasonable research ideas, but they show systematic biases toward certain types of ideas and miss the full diversity of how human researchers approach novel contributions.
This paper evaluates how LLM-generated research ideas compare to human researcher ideas by analyzing papers and their cited prior works.