Diffusion-based image synthesis using ControlNet attracted attention recently.
Vanilla ControlNet requires extensive training of around 5000 steps for a single task.
A novel Meta ControlNet method is introduced which significantly reduces learning steps to 1000 and achieves zero-shot adaptability in edge-based tasks.
Meta ControlNet achieves control in only 100 finetuning steps in complex non-edge tasks, outperforming existing methods.