A naukri.com initiative
Medium
2w
372
Accelerating AI with great data
- Capital One talked in their recent AWS Re:Invent 2024 session regarding their approach towards producing high quality data that is governed and easy to use to accelerate AI use cases.
- Capital One emphasizes the importance of proper data registration, inventory, and control to ensure quality and accessibility and to build a reliable data ecosystem, ultimately transforming data into a valuable asset.
- In a server-less first approach, Capital One provides a self-service data portal for data producers which they can use to easily onboard new datasets, reducing the time and effort that is required to make data available for consumption. Automation is said to streamline data processes and reduce errors, and focus on scalability holds the key to handling the rapidly increasing volume and complexity of big data.
- The company uses AWS services such as S3, Route 53, Lambda, and step functions to build ethical, reliable and scalable data pipelines, the environment that guides the flow of data within the organization.
- To automate their standards and scale them, the company has established centralized platforms for publishing data that enforces governance, quality checks and support for different data stores. It relies on federated data models to provide teams complete control of the Spark compute infrastructure in the data plane while keeping governance check intact.
- To ensure a consistent and user-friendly experience for both the producers and the consumers while maintaining governance, Capital One is building a trustworthy data ecosystem with streamlined experiences, mechanisms for enforcement and a focus on rapid experimentation.
- The end goal is not just managing the growing volume, variety and velocity of data but finding meaningful insights for business value and enhancing customer experiences.
- This approach is essential for building a reliable data foundation and ensuring that capital one AI mitigates the impact of complexity and evolves constantly, enabling innovation and impactful outcomes.
- The company leverages a vast amount of data to experience the right performance for its models and build trust and transparency into AI-driven decisions to improve the intelligence of AI and drive better customer experiences.
- Capital One is transforming the financial services industry by building innovative solutions in-house, thanks to its world-class team that is changing banking for good. Also, the company is not affiliated with, nor endorsed by, any third parties mentioned and is not responsible for content or privacy policies of any linked third-party sites.
Read Full Article
22 Likes
For uninterrupted reading, download the app