Diffusion-based generative models use SDEs and probability flow ODEs to transform complex data distributions into manageable prior distributions.
A geometric regularity has been discovered in the deterministic sampling dynamics of these models, where trajectories exhibit a consistent 'boomerang' shape in an extremely low-dimensional subspace.
This regularity persists regardless of model architecture, conditions, or generated content and has been studied using kernel-estimated data modeling.
The research also introduces a dynamic programming-based scheme to synchronize the sampling time schedule with the identified trajectory structure, leading to enhanced image generation performance with minimal computational overhead.