NVIDIA has recently rolled out the Confidential Bare Metal deployment solution. This innovative offering empowers state-of-the-art model developers to safely execute sensitive workloads on third-party dedicated infrastructure, all the while retaining complete control over their models and data.

In terms of security mechanisms, this solution leverages hardware-level isolation, encrypted verification, and stringent access restrictions. These measures work in tandem to provide all-round protection for the security of models and data during the runtime.

As for its application scope, currently, NVIDIA's support for confidential computing has been expanded to encompass Grace Blackwell NVL72, HGX Rubin NVL8, and DGX Rubin NVL8 systems. Moreover, it will be seamlessly integrated into the DSX OS.

In the ecosystem collaboration aspect, Google Cloud is set to offer support for this solution on A4X Max instances that are equipped with NVIDIA GB300 NVL72 systems. Meanwhile, Cohere has plans to incorporate it into the Cohere Model Vault.