Red Hat Unveils llm-d Community with Founding Support from NVIDIA and Google Cloud
2025-05-27 / Read about 0 minute
Author:小编   

Red Hat has recently announced the launch of a novel open-source initiative, llm-d, tailored to address the extensive inference demands of generative AI. This groundbreaking project is a collaborative effort among founding contributors such as CoreWeave, Google Cloud, IBM Research, and NVIDIA. By leveraging cutting-edge technology, llm-d aims to empower large language model (LLM) inference clouds to meet rigorous service-level objectives (SLOs) in production environments.