<ul><li>Most prior state space models (SSMs) use complex numbers in their state representation, but it has been observed that real-valued SSMs can also work well in certain cases.</li><li>The choice between real and complex-valued SSMs depends on the type of data modality, with complex numbers being helpful for continuous modalities like audio and video, while real numbers work well for discrete modalities like text and DNA.</li><li>There are suggested special initializations for SSMs, particularly in the complex-valued case, to improve performance in low-data regimes. However, various initializations are expected to work fine, especially in large-data and real-valued SSM regimes.</li><li>Selective SSMs, abbreviated as S6 models, are state space models with a selection mechanism and computed with a scan.</li></ul>

The Key Differences Between Real and Complex-Valued State Space Models

Discover more