Based on the real-world tests carried out by GiggleHD, the AMD X3D processor has showcased outstanding performance in RAG (Retrieval-Augmented Generation) AI benchmark tests, far surpassing initial expectations. It outperforms non-X3D chips by a margin of up to 88%. RAG AI technology is designed to enhance the quality of responses generated by large AI models by retrieving relevant information from external vector databases. In this process, the CPU shoulders the primary computational burden of conducting vector searches. As the workload of Agentic AI grows, issues related to CPU latency become increasingly pronounced.
The tests were specifically tailored to personal PCs and small-team single-node scenarios, involving approximately 100K to 200K vectors. The results revealed that when conducting batch searches of 100K vectors, the X3D CPU demonstrated a speed advantage of up to 88% over non-X3D chips. In tests involving 200K vectors, the 8-core Ryzen 7 9850X3D outpaced the Ryzen 7 9700X by more than 50%. Moreover, the 8-core X3D chip exhibited superior speed compared to the 16-core Ryzen 9 9950X. Additionally, the X3D chip also delivered exceptional performance in index construction tasks.
