<ul data-eligibleForWebStory="true"><li>Baidu has open-sourced the ERNIE 4.5 models, including language and multimodal AI variants, under the Apache 2.0 license.</li><li>ERNIE-4.5 variants outperform competitors like DeepSeek-V3 671B and Alibaba's Qwen3-30B-A3B on benchmarks.</li><li>The core innovation of ERNIE 4.5 models is the heterogeneous modality Mixture of Experts (MoE) structure for multimodal learning.</li><li>Through extreme optimizations, the largest ERNIE 4.5 model achieved high FLOPs utilization on NVIDIA H800 GPUs using advanced training techniques.</li></ul>

Baidu’s ERNIE 4.5 is Built On a ‘Heterogeneous MoE’ Architecture

Discover more