During an interview, Jensen Huang, the CEO of NVIDIA, articulated that the establishment of AI factories necessitates a substantial volume of energy, encompassing both natural gas and renewable energy resources. However, he underscored that the linchpin to success lies in energy efficiency. Huang highlighted that each successive generation of NVIDIA's offerings amplifies data processing capacity (throughput) by a factor of ten, while merely doubling its power consumption—a testament to the strides made in enhancing energy efficiency.
He directly correlated energy efficiency with commercial viability, noting that the energy efficiency of data centers has a direct bearing on customer revenue streams. Specifically, he explained that with a consistent level of power consumption, heightened efficiency translates into the generation of a greater number of tokens, subsequently bolstering revenue. Huang reiterated the pivotal role of energy efficiency, stating that NVIDIA's persistent objective is to achieve the milestone of 'generating one token per dollar'.
