<ul><li>Akamai Technologies Inc. launches Akamai Cloud Inference, a distributed platform for running large language models closer to users.</li><li>The service is built on the highly distributed Akamai Cloud to address issues with centralized cloud-based models.</li><li>Running language models in centralized platforms leads to latency issues due to data location.</li><li>Akamai focuses on moving AI data closer to users at the edge for more efficient inference.</li><li>The company's extensive network from its CDN roots gives it a distributed advantage.</li><li>Akamai's cloud infrastructure spans over 4,100 points of presence in more than 130 countries.</li><li>Akamai Cloud Inference promises triple the throughput, reduced latency, and cost savings for AI inference.</li><li>The service offers flexible compute resources, including GPUs and ASICs, for various AI workloads.</li><li>Advanced data management capabilities are provided through a partnership with Vast Data Inc.</li><li>Edge compute capabilities enable serverless infrastructure for latency-sensitive AI applications.</li></ul>

Akamai distributes AI inference across the globe, promising lower latency and higher throughput

Discover more