A novel multi-layered hierarchical HITL DRL algorithm is introduced for decision-making problems.The algorithm combines self learning, imitation learning, and transfer learning.Human inputs in the form of reward, action, and demonstration are considered.Multiple challenges, trade-offs, and advantages of HITL are discussed in solving complex problems.