AMD XDNA 2 NPU Gains Unsloth Local Interface Support
9 hour ago / Read about 0 minute
Author:小编   

AMD has announced that the XDNA 2 NPU in Ryzen AI processors is the first neural processing unit to support the Unsloth Desktop local interface. In use, compatible applications send model requests to the Unsloth Desktop API, where Lemonade and FastFlowLM handle model serving and inference on the AMD XDNA 2 NPU, returning the results to the application for use in its workflow. This allows over a hundred agent applications—including OpenClaw and Hermes—to run locally on the NPU of Ryzen AI processors via Unsloth Desktop, offloading related AI workloads from the CPU and GPU to free up more compute for other tasks and helping to extend battery life on battery-powered devices.