Building an AWS Support Voice Assistant with Amazon Nova envisioned a voice assistant that understands AWS documentation, visually analyzes AWS Console screen, and provides context-aware answers.
The project leveraged Amazon Nova Sonic model for real-time conversational exchanges and Amazon Nova Lite for multimodal screen analysis, ensuring natural speech interactions and tool augmentation.
The tool was built using AWS Sample Sonic CDK Agent repository with components like Amazon CloudFront, Amazon S3, Python application on ECS, Amazon Cognito for authentication, and WebSockets for real-time communication.
Amazon Nova Sonic integrates with backend tools through tool definitions and invocations, while Nova Lite provides visual screen analysis by interpreting user screens, offering a step towards interactive, conversational AI mentorship.