One of the major challenges in machine learning is maintaining the accuracy of the deployed model in a non-stationary environment.
The proposed method is a task-conditioned ensemble of expert models for continuous learning of the deployed model with new data.
The method uses in-domain models and task membership information to dynamically adapt the deployed model to new data while retaining accuracy on old data.
The experiments conducted on different setups demonstrate the benefits of the proposed method.