<ul data-eligibleForWebStory="false">Spotify improved its platform by integrating annotation into the ML lifecycle, creating a dedicated platform for scalability and integration.A hybrid approach using large language models helped automatically label straightforward cases, increasing throughput and reducing costs.The platform computed agreement scores to detect inconsistencies, ensuring consistent quality by escalating low-agreement items to quality analysts.Annotation became a key enabler of data-driven development at scale, allowing ML teams to test, refine, and ship features faster at Spotify.