Decentralized wireless network with several source-destination pairs sharing limited frequency bands.Sources adapt band selection strategy without information sharing.Proposed Fair Share RL (FSRL) solution achieves fairness without coordination.FSRL can be up to 89.0% fairer compared to baseline RL algorithm.