This paper presents a method for distributed optimal control for linear networked systems using graph recurrent neural networks (GRNNs).The existing approaches for this problem result in centralized optimal controllers with offline training processes.The main contribution of this work is the development of a distributed, online training approach for the optimal controllers.The method is demonstrated through numerical simulations using a dedicated simulator.