Canonical, in collaboration with NVIDIA, introduces a reference architecture for building robust LLM chatbots.The solution leverages NVIDIA AI technology and offers a production-ready AI pipeline built on Kubernetes.Key components include NVIDIA NIM for optimized model deployment, OpenSearch as a vector database, and Kubeflow and KServe for powerful AI workflow.The solution provides enhanced security, compliance, and advanced capabilities for various generative AI workflows.