Deep Reinforcement Learning techniques are achieving state-of-the-art results in robust legged locomotion.URMA (Unified Robot Morphology Architecture) is introduced as a framework to control different embodiments of legged robots.The framework utilizes an end-to-end Multi-Task Reinforcement Learning approach and morphology-agnostic encoders and decoders.Experiments show that URMA can learn a locomotion policy that can be transferred to unseen robot platforms in simulation and the real world.