Pre-training as we know it will end due to the finite nature of data and the challenge of data scarcity.Foundational models rely on pre-training scaling for improvements, but there are diminishing returns.The lack of critical details about advanced pre-training models hinders clear assessment of its limits.The future of AI will focus on agents, synthetic data, and inference-time computing.