This research paper introduces a method called DP-IHT-H for differentially private sparse linear regression with heavy-tailed responses in high-dimensional settings.
DP-IHT-H leverages the Huber loss and private iterative hard thresholding to achieve an estimation error bound under the differential privacy model.
Another method proposed in the paper, DP-IHT-L, further improves the error bound under additional assumptions on the response and achieves better results.
Experiments conducted on synthetic and real-world datasets show that these methods outperform standard differentially private algorithms designed for regular data.