Jim Ferguson is currently Director of Product Management at RVO Health, with a background in IT and product management across various companies.
He led an initiative at RVO Health to automate the manual process of approving or rejecting patient reviews using AI, improving efficiency and user experience.
The project aimed to reduce the backlog of user-submitted reviews and ensure they met editorial guidelines, attributing ratings correctly.
By incorporating AI tools, the approval rate of reviews increased from 60% to about 80%, enhancing user satisfaction and accuracy.
Challenges included training the engineering team on AI, balancing complexity with simplicity for stakeholders, and addressing fears about job automation.
Training the AI involved using historical data, stakeholder feedback, and ensuring the tool provides reasons for review rejections.
Implementing the AI solution involved parallel deployment with human verification, achieving a high accuracy rate of around 96% in review approvals.
Real-time feedback features were added to guide users during review submissions, improving accuracy and user experience.
Communicating the initiative to stakeholders involved relating AI to rule enforcement, explaining the technology's language analysis capabilities.
Reflections on the project include the importance of early stakeholder involvement and the ongoing application of learnings to future initiatives.