The performance of deep neural networks scales with dataset size and label quality.In this work, a Weighted Adaptive Nearest Neighbor (WANN) approach is proposed to mitigate low-quality data annotations.WANN outperforms reference methods and exhibits superior generalization on imbalanced data.The proposed weighting scheme enhances supervised dimensionality reduction and minimizes latency and storage requirements.