Researchers implement a versatile and scalable training algorithm, direct feedback alignment, on a hybrid electronic-photonic platform.
An optical processing unit achieves large-scale random matrix multiplications at speeds up to 1500 TeraOPS.
Optical training of modern deep learning architectures, including Transformers with over 1 billion parameters, is performed with good performance on various tasks.
The hybrid opto-electronic approach shows potential for ultra-deep and wide neural networks, offering a promising way to extend the growth of artificial intelligence beyond traditional approaches.