Euclidean diffusion models have been successful in generative modeling, with recent advancements focusing on manifold data.
A study explores the challenges posed by the singularity of the score function in manifold-constrained data when using Euclidean diffusion models.
Two novel methods, Niso-DM and Tango-DM, are proposed to mitigate the singularity and improve sampling accuracy by addressing scale discrepancies and training only the tangential component of the score function.
Numerical experiments demonstrate that these methods outperform existing approaches on distributions over complex geometries in manifold data.