Today's AI agents can handle the engineering work of research but struggle with the creative, strategic, and judgment-based aspects that define actual research progress—suggesting we're far from automating AI R&D despite recent capability improvements.
Researchers tested whether AI agents can conduct open-ended AI research by having them tackle real unpublished research papers over six days with substantial compute.