MaCP is a new adaptation method, Minimal yet Mighty adaptive Cosine Projection, designed for fine-tuning large foundation models.
It utilizes cosine projection to improve model efficiency and accuracy by projecting weight changes into discrete cosine space.
MaCP has been shown to be effective across various tasks including natural language processing, image classification, and video understanding.
Experiments demonstrate that MaCP offers superior accuracy, reduced computational complexity, and lower memory requirements compared to existing methods.