-
Part 3: Building the Keystone – Dataproc Custom Images for Secure Boot & GPUs
Part 3: Building the Keystone – Dataproc Custom Images for Secure Boot & GPUs In Part 1, we established a secure, proxy-only network. In Part 2, we explored the enhanced install_gpu_driver.sh initialization action. Now, in Part 3, we’ll focus on using the LLC-Technologies-Collier/custom-images repository (branch proxy-exercise-2025-11) to build the actual custom Dataproc images embedded with…
-
Part 2: Taming the Beast – Deep Dive into the Proxy-Aware GPU Initialization Action
Part 2: Taming the Beast – Deep Dive into the Proxy-Aware GPU Initialization Action In Part 1 of this series, we laid the network foundation for running secure Dataproc clusters. Now, let’s zoom in on the core component responsible for installing and configuring NVIDIA GPU drivers and the associated ML stack in this restricted environment:…
-
Signed NVIDIA drivers on Google Cloud Dataproc 2.2
Hello folks, I’ve been working this year on better integrating NVIDIA hardware with the Google Cloud Dataproc product (Hadoop on Google Cloud) running the default cluster node image. We have an open bug[1] in the initialization-actions repo regarding creation failures upon enabling secure boot. This is because with secure boot, kernel driver code has its…