menu
techminis

A naukri.com initiative

google-web-stories
Home

>

ML News

>

Learning l...
source image

Arxiv

3d

read

398

img
dot

Image Credit: Arxiv

Learning long range dependencies through time reversal symmetry breaking

  • Deep State Space Models (SSMs) are bringing physics-grounded compute paradigms back into the spotlight.
  • Recurrent Hamiltonian Echo Learning (RHEL) is a new algorithm proposed to compute loss gradients efficiently for non-dissipative, Hamiltonian systems.
  • RHEL requires only three forward passes regardless of model size, without explicit Jacobian computation, ensuring consistent gradient estimation.
  • RHEL has been shown to match the performance of Backpropagation Through Time (BPTT) in training Hamiltonian SSMs on time-series tasks, demonstrating scalability and efficiency.

Read Full Article

like

23 Likes

For uninterrupted reading, download the app