Lun Wang, a former researcher at Google DeepMind, has sparked debate in the AI community by asserting that the industry's primary bottleneck is not computational power, data, or energy, but rather the evaluation system itself. In a detailed blog post published on May 17, 2026, Wang argues that current evaluation methods fail to predict when AI models will develop new capabilities, citing historical examples of emergent capabilities and grokking as evidence.
Wang's critique centers on the assumption that AI models are merely enhanced versions of their predecessors, which he claims undermines the industry's ability to foresee significant shifts in AI capabilities. He warns that without accurate evaluation metrics, the AI industry risks training models to solve the wrong problems, potentially leading to unforeseen failure modes. Wang's insights challenge the industry's current focus on scaling and highlight the need for a more robust evaluation framework to guide future AI development.
Former DeepMind Researcher Highlights Evaluation as AI's Core Bottleneck
Disclaimer: The content provided on Phemex News is for informational purposes only. We do not guarantee the quality, accuracy, or completeness of the information sourced from third-party articles. The content on this page does not constitute financial or investment advice. We strongly encourage you to conduct you own research and consult with a qualified financial advisor before making any investment decisions.
