SSMs can only track commutative groups when using diagonal real/complex updates; adding quaternion channels enables tracking of non-commutative groups like S₅ while keeping linear-time inference, and the learned weights become directly interpretable.
This paper uses representation theory to explain why standard state space models (SSMs) fail at tracking non-commutative sequences, and proposes HyperSSM, which adds quaternion-valued channels to handle complex group structures while maintaining efficient inference. The theory directly explains what SSM weights must encode, enabling interpretable learning of geometric transformations.