Developing advanced reasoning capabilities in Large Language Models (LLMs) is a challenge.Process Reward Models (PRMs) show promise in enhancing reasoning, particularly in mathematical reasoning.In this work, GraphSILO dataset is introduced for graph reasoning problems with step-wise labels.Experimental results show that GraphPRM significantly improves LLM performance in graph reasoning tasks and other domains.