Google Unveils New Algorithm That 'Shrinks KV Cache Sixfold,' Casting Shadow Over U.S. Memory Stocks
4 hour ago / Read about 0 minute
Author:小编   

On Wednesday, as trading commenced on the U.S. stock market, the overall mood remained steady; however, the memory sector lagged behind, with shares of companies such as Micron Technology and SanDisk experiencing a downturn. The primary driver of this market turbulence was Google's announcement of a cutting-edge compression algorithm, TurboQuant, which holds the promise of significantly reducing the memory demands of artificial intelligence systems. TurboQuant technology is not limited to compressing key-value caches and boosting performance; its applications extend far beyond AI models. Google has scheduled a demonstration of this technology for April. Anticipation of a possible transformation in memory demand prospects has already begun to ripple through the market. Analysts at Wells Fargo observed that widespread adoption of this technology could lead to an optimization of the memory cost curve and might impact future assessments of memory capacity requirements. Nevertheless, questions linger regarding the technology's potential for broad dissemination and whether test outcomes can be seamlessly translated into real-world production settings. Additionally, on Wednesday, Google's stock price dipped briefly below $290, marking a retreat of nearly 17% from its all-time high in early February.