Agents in dynamic domains like autonomous robotics and video game simulations must adapt to new tasks while retaining past knowledge.Continual Reinforcement Learning poses challenges of forgetting past knowledge and scalability.A novel framework called HIerarchical LOW-rank Subspaces of Policies (HILOW) is introduced for continual learning in offline navigation settings.HILOW leverages hierarchical policy subspaces for flexible and efficient adaptation to new tasks while preserving existing knowledge.