At its KubeCon event held in Utah, members of the community explored the potential of AI app delivery and machine learning in the container ecosystem.
Challenges around feature and platform fragmentation led to discussions around the need for standardisation and interoperability in AI application delivery.
Increased demand for AI governance capabilities was emphasized during sessions on AI safety, amid concerns over the risks posed by malicious actors exploiting AI vulnerability.
Talks around AI middleware, aimed at simplifying complexities for platform engineers, data scientists and developers, enhanced Scalability and safety of AI-powered applications.
Open source heavyweight adopter CapitalOne was highlighted for using GenAI in not just customer service and engineering but also mundane back-office tasks for greater efficiency.
AI middleware was suggested as a solution to the complex interoperability challenges facing application platforms in supporting GenAI app delivery while still being flexible and adaptable.
Senior staff engineer at Shopify, Shane Lawrence, highlighted ongoing threats to AI models and the need for cohesive AI middleware to mitigate risks.
AI is being seen as a essential shift in application architecture and capabilities that is here to stay, however, clear-eyed concerns around the gaps in AI app governance must also be addressed.
KubeCon North America 2024 had members of the community coming together to freely exchange knowledge and ideas. Projects are also being established for AI application governance.
Emerging projects having governance established for their AI applications. VMware Tanzu AI solutions design partner applications encouraged for those interested in shaping the future of AI solutions.