Fitting state space model to RNNs does a really good job (capturing like 90% of the variance)
To understand RNN computations, we globally linearized their hidden-unit activity using high-dimensional linear-Gaussian state-space models (SSMs).
High-d SSMs (latents dim > obs dim) have great performance, and are interpretable through tools from dynamical systems and control theory.