Arm: AI development will deepen GPU/CPU architecture

2025/06/06

TechNews Technology News
May 20, 2025
Author MoneyDJ

Arm senior vice president Chris Bergey pointed out that AI inference will be the core of Arm's future layout. At the same time, the rapid expansion of inference in terminals and data centers will drive the widespread adoption of Arm architecture IP. As the focus of AI computing shifts from training to inference, Bergey said that whether it is CPU, GPU or NPU, their respective positioning and value are being reorganized.

The application scope of GPU is extending from graphics to AI inference, accelerating high-computing density scenarios such as image upscaling; and CPU is still the main deployment platform for developers due to its popularity and versatility. Although NPU has advantages in power consumption performance, it still needs to prove its system integration value.

Bergey pointed out that in the past, the market focused on AI training, but inference is the key to realizing AI commercialization, especially at the edge device end, which has more real-time and energy efficiency advantages. In recent years, Arm has not only maintained a dominant position in mobile devices and IoT, but has also successfully expanded to data centers, including AWS, Google and other cloud operators have invested in the development and deployment of Arm architecture chips.

Regarding chip design trends, he mentioned that since 2021, NVIDIA has pointed out that the traditional x86 architecture is difficult to support the I/O and bandwidth requirements of AI computing, and Arm has become a scalable option in the AI era because of its flexible architecture advantages. Bergey emphasized: "The Arm platform is not only consistent in terminal devices, but also a common foundation for data center software development."

In terms of software support, Bergey shared the progress of the AI acceleration library Kleidi, which has been integrated into Microsoft ONNX Runtime, Meta's ExecuTorch, Google LiteRT and Tencent's mixed model. It is estimated that Kleidi has reached 8 billion installations in one year, indicating that the ecosystem acceptance is expanding rapidly.

Bergey also mentioned that the terminal computing subsystem (CSS) released in 2024 is gradually entering the market, and there are currently many products equipped with Cortex-X925, including MediaTek Dimensity 9400 and NVIDIA DGX Spark. He predicted that a new generation of CPU products with double-digit IPC improvements will be launched later in 2025, and the development of mobile GPUs will continue to be strengthened.

Talking about the changes in the PC market, he pointed out that users' expectations for laptop battery life, heat dissipation and multimedia experience in the post-epidemic era have driven the industry to transform towards a thinner and more efficient Arm architecture. Bergey is also optimistic about the future penetration of Chromebooks on the Arm platform.

In the face of the rapid evolution of the AI market, he believes that Arm's greatest value lies in providing a consistent and scalable platform that allows developers to develop from wearable devices to ultra-large-scale computing platforms. He emphasized: "Arm's role is not to dominate the terminal, but to empower the entire ecosystem."

Related link: https://technews.tw/2025/05/20/arm-ai-development-will-deepen-gpu-cpu-architecture/
Image source: shutterstock

【Disclaimer】
The content of this article only represents the author's personal opinion and has nothing to do with Creating.
The content, textual description and originality have not been verified by this site. This site does not make any guarantee or commitment to this article and all or part of its content, authenticity, completeness, and timeliness. It is for readers' reference only. Please verify the relevant content yourself.

Creating Nano Technologies, Inc.
59 Alley 21 Lane 279, Chung Cheng Road, Yung Kang City, Tainan, TAIWAN
TEL:886-6-2323927 FAX:886-6-2013306 URL: http://www.creating-nanotech.com

BACK TO LIST