Generative AI is finding increasing use in document search.
Organisations deploying these tools are concerned that only authenticated and authorised personnel can access documentation.
A solution involving documented metadata, Amazon OpenSearch Service and Amazon Cognito allows organisations to control document access on a customised, role-based access mechanism.
OpenSearch Service stores document files as numeric values, with similarity searches made through querying the similarity between a query vector and existing vectors stored in the database to return documents.
Despite the need to make documents available to various employees in manufacturing, HR, finance and sales, there are sometimes specific limits required, and access must be restricted.
Documentation access can be controlled by various factors such as access level and department, to ensure documents with confidential information or customer strategy details are only viewable by those with authorisation.
Restricting access to documentation which is controlled by metadata and OpenSearch Service gives a simpler approach to access management than traditional multi-tenant document securities, and provides a way to access business-specific content quickly.
Deployment of the solution utilises the AWS CDK to access AWS Amplify, embedded in which is Amazon Cognito and the OpenSearch Service.
For Rolls Royce's example, the search mechanism was able to handle queries directly on its 10-terabyte unstructured document corpus in minutes.
With the AWS CDK, most resources can be tidied up piecemeal when the solution is no longer needed.