Bengaluru’s Ziroh Labs and IIT Madras have developed Kompact AI, which enables advanced AI models to run on ordinary CPUs.
The use of standard CPUs instead of expensive GPUs shifts the focus towards making AI accessible to everyone using existing hardware.
While GPUs are costly and energy-intensive, Kompact AI allows large language models to run on CPUs, which are already present in billions of devices.
By providing AI capabilities on standard CPUs, Kompact AI aims to bridge the AI divide, allowing organizations without GPU farms to participate in the AI revolution.