Hiring a PM is a diverse process across orgs, but it broadly follows the steps of skill identification, evaluation, and decision-making.
The key reason you get mixed bag of PMs is Step 2 — evaluation on different skills.
The first tactic to improve the usual hiring process is to figure out which interviewers are best suited to evaluate what skill.
The second tactic is to encourage interviewers to take notes during the interview.
The third tactic is to ask the same set of questions to all candidates to evaluate their relative strengths, famously called the ‘Israeli Defence Force Recruitment Process’.
The hard parts of hiring a PM are assignments, bias, making of a good interviewer, the bar raiser, self-awareness, projects, and reference checks.
To remove bias in the interview process, the interview notes should not be shared amongst the other interviewers.
The bar raiser approach aims to raise the average level of effectiveness of the group they're entering.
Reference checks can be valuable if done well, and they should be done across multiple companies where the candidate has worked.
A good hiring process can help you hire the best candidates whose skills fit your company culture and objectives.