LLM-brain alignment doesn't require full model representations; a tiny low-dimensional subspace captures most neural predictivity, and these dimensions differ from what PCA identifies as important, revealing that models align with brains through specific, interpretable features rather than their ...
This paper shows that LLMs align with human brain activity during language listening through a surprisingly small subset of their representations—just 1-3% of dimensions.