AI literary translation is competent but lacks the immersive quality readers value—and automatic metrics don't capture what makes human translation better, suggesting we need reader-centered evaluation for creative content.
Researchers compared AI-generated literary translations to human translations by having 15 avid readers evaluate excerpts from 15 recent novels in French, Polish, and Japanese. While readers found AI translations adequate, they consistently preferred human translations for their clarity and immersive quality.