Apple Engages in Discussions with AI Startup to Facilitate Direct Operation of Large AI Models on iPhones
3 hour ago / Read about 0 minute
Author:小编   

On July 15, CNBC broke the news that Apple is currently in the preliminary stages of talks with the AI startup PrismML. The focus of these discussions is to assess PrismML's AI model compression technology, with the ultimate goal of enabling large AI models to operate seamlessly on iPhones and diminish dependence on cloud computing. PrismML has asserted that its cutting-edge technology can significantly slash model memory usage by a factor of 10 to 15. This breakthrough means that AI models boasting a staggering 27 billion parameters can now be executed on iPhone 15 and subsequent models. Notably, this advancement leads to a remarkable 6- to 8-fold increase in response speed, coupled with a substantial 3- to 6-fold reduction in energy consumption. Should this technology reach full maturity, Apple stands to gain the ability to localize a greater number of Siri and generative AI functions. This localization would bring about a trifecta of benefits: faster response times, enhanced privacy protection, and improved offline user experiences, all while simultaneously cutting down on cloud computing expenses. Nevertheless, industry experts have sounded a note of caution. They emphasize that the technology still necessitates extensive application validation. Moreover, its potential impact on battery life, system stability, and long-term performance remains an open question, awaiting further investigation and testing.