Kong has announced updates to its AI Gateway, a platform for governance and security of LLMs and other AI resources.
The AI Gateway 3.10 includes a RAG Injector feature to reduce LLM hallucinations by querying the vector database and inserting relevant data.
Another update is the automatic personally identifiable information (PII) sanitization plugin, which protects over 20 categories of PII across 12 languages.
Kong aims to provide robust AI infrastructure for seamless integration, improved security, and addressing challenges with LLMs.