Toxicity detection is crucial for maintaining the peace of the society.Existing methods are vulnerable to evolving perturbation patterns created by malicious users.A new dataset with 9 types of perturbation patterns has been constructed to validate the vulnerability of current methods.A domain incremental learning paradigm and benchmark are proposed to ensure robustness to dynamically emerging types of perturbed toxic text.