Emerging startup Acrab has rolled out its inaugural GΞLIX 1 SoC chip, specifically tailored for edge AI terminal devices. Crafted through a cutting-edge 5nm manufacturing process, this chip enables the local operation of AI models boasting up to 100 billion parameters. Its standout feature lies in its heterogeneous architecture, which seamlessly integrates a 20-core Arm CPU, a GPU with a computing capacity of 3TFLOPS, an NPU, and other essential components. This integration culminates in an impressive AI computing prowess of up to 650TOPS, complemented by ample cache capacity and high-bandwidth memory.

Leveraging hardware-accelerated attention mechanisms and prefill optimization techniques, the GΞLIX 1 chip attains a remarkable prefill rate of 1416.8 Token/s under specific configurations. This performance milestone represents a 7.5-fold increase compared to the Apple M4 Pro Mac Mini. Furthermore, Acrab goes beyond hardware by offering comprehensive software stacks and agent reference designs. To showcase the chip's capabilities, the company has also developed a first-party terminal device, dubbed Agent Box, tailored to harness the full potential of the GΞLIX 1 chip.