On November 21, Huawei is set to unveil a revolutionary technology in the realm of artificial intelligence (AI), with the anticipation of resolving the long-standing issue of suboptimal utilization efficiency of computing resources. More precisely, this innovative technology has the potential to elevate the utilization rate of computing resources, including GPUs and NPUs, from the industry's typical range of 30% to 40% up to an impressive 70%, thereby fully harnessing the capabilities of computing hardware.
It has been disclosed that, through cutting-edge software innovation, this technology enables unified management and utilization of a diverse array of computing resources, encompassing NVIDIA, Ascend, and other third-party options. By effectively concealing hardware disparities, it offers a more streamlined and efficient resource support system for both AI training and inference processes.
