Randomized Smoothing (RS) is a promising technique for certified robustness in deep neural networks.
A new approach called SmOothed Multi-head Ensemble (SOME) is proposed, which uses multiple augmented heads with a cosine constraint inside a single DNN.
SOME achieves improved robustness with reduced computational costs compared to traditional ensemble methods of multiple DNNs.
Extensive experiments and discussions confirm the effectiveness and efficiency of SOME for certifiably-robust RS-based defense.