Graph Neural Networks (GNNs) are widely used in graph data mining tasks.Traditional GNNs face limitations in terms of over-smoothing and over-squashing, which limit the receptive field in message passing processes.To address these limitations, a new approach called Structure-aware Multi-token Graph Transformer (Tokenphormer) is proposed.Tokenphormer generates multiple tokens to capture local and structural information, exploring global information at different levels of granularity.