Large language models (LLMs) are gaining interest in industry for their impressive capabilities.
The adoption of LLMs presents challenges in integration, utilization of proprietary data and models, and meeting requirements.
A shift towards compound AI systems, with a blueprint architecture for orchestrating agents and data in enterprise applications, is proposed.
The architecture involves coordinating data and instructions among agents using streams, mapping models and APIs to agents, and utilizing proprietary data through a data registry.