<ul data-eligibleForWebStory="true"><li>Ed Crewe is set to speak at PyConLT 2025, focusing on Cloud Pricing.</li><li>As a member of the EDB team, he works on the Postgres AI product, operating across AWS, Azure, and GCP.</li><li>The talk delves into the complexity of cloud pricing, dealing with vast SKU lists.</li><li>Development of a data pipeline to manage and update service SKUs is discussed.</li><li>The extraction process aims to efficiently handle the 5 million service SKUs.</li><li>Implementation details including data scraping, tools like Airflow, and Python code are presented.</li><li>The scraper class uses abstract base methods for fetching and inserting prices.</li><li>Use of Postgres Embedded with Go for temporary databases and data retrievals is highlighted.</li><li>A Click wrapper facilitates tasks like scraping, dumping Postgres files, and running tests.</li><li>Soda data validation is employed to ensure accuracy and integrity of the scraped data in the pipeline.</li></ul>

Ed Crewe: Talk about Cloud Prices at PyConLT 2025

Discover more