Deferring systems extend supervised Machine Learning (ML) models with the possibility to defer predictions to human experts.
This paper evaluates the impact of deferring strategies on system accuracy through a causal lens.
The potential outcomes framework for causal inference is linked with deferring systems to identify the causal impact of the deferring strategy on predictive accuracy.
The approach is evaluated on synthetic and real datasets for seven deferring systems from the literature.