menu
techminis

A naukri.com initiative

google-web-stories
Home

>

ML News

>

Contrastiv...
source image

Arxiv

1w

read

34

img
dot

Image Credit: Arxiv

Contrastive Consolidation of Top-Down Modulations Achieves Sparsely Supervised Continual Learning

  • Biological brains learn continually from unlabeled data and integrate specialized information from sparsely labeled examples without compromising generalization.
  • Machine learning methods face catastrophic forgetting in natural learning settings, where supervised specialist fine-tuning degrades performance on original tasks.
  • Task-modulated contrastive learning (TMCL) is introduced, inspired by neocortical biophysical machinery, integrating top-down information continually and unsupervisedly using predictive coding principles.
  • Experiments demonstrate improvements in class-incremental and transfer learning over state-of-the-art unsupervised methods, suggesting the importance of top-down modulations in balancing stability and plasticity.

Read Full Article

like

2 Likes

For uninterrupted reading, download the app