Performance predictors are used in neural architecture search (NAS) to reduce evaluation costs by estimating architecture performance.
Choice of loss functions heavily influences the effectiveness of predictors.
Recent approaches have explored ranking-based loss functions in addition to traditional regression loss functions.
A study categorized loss functions into regression, ranking, and weighted types, showing that combining specific categories can enhance predictor-based NAS.