Performance gap across classes remains a persistent challenge in machine learning, often attributed to variations in class hardness.Hardness-based resampling is a promising approach to mitigate performance disparities.Resampling does not meaningfully affect class-wise performance disparities, contrary to theoretical expectations.Detailed analyses help identify key challenges unique to hardness-based imbalance and provide guidelines for future research.