Many dynamic decision problems, such as robotic control, involve diverse and unknown tasks at training time.Existing approaches like multi-task and meta reinforcement learning struggle to generalize with task diversity.This paper proposes a policy committee approach to address the challenges of task diversity.Experiments demonstrate that the proposed approach outperforms existing baselines in training, generalization, and few-shot learning.