Skip to content

e2e: add bare mental workload gpu test - #2808

Open
Yu-Jack wants to merge 1 commit into
harvester:mainfrom
Yu-Jack:test-2596
Open

e2e: add bare mental workload gpu test#2808
Yu-Jack wants to merge 1 commit into
harvester:mainfrom
Yu-Jack:test-2596

Conversation

@Yu-Jack

@Yu-Jack Yu-Jack commented Aug 4, 2026

Copy link
Copy Markdown
Collaborator

Which issue(s) this PR fixes:

#2596

What this PR does / why we need it:

- Background

Before using workload GPU in bare-metal mode, gpu-operator must be installed.

- How GPU Support Is Detected

The test uses the presence of gpu-operator's crucial pods as an indicator of GPU availability on the node:

  • Pods are running → GPU is present on the node → proceed with the test
  • Pods are not found → GPU is not available → skip the test

- Test Flow

Happy path (GPU supported):

  1. Verify gpu-operator is installed and its crucial pods are up
  2. Create a container with nvidia.com/gpu resource request
  3. Confirm the pod starts successfully → bare-metal workload GPU is functioning

Skip path (GPU not supported):

  1. crucial pods of gpu-operator are not detected
  2. Test exits early and emits a warning message — no failure is reported

Special notes for your reviewer:

Example A - detect a gpu on the node
2026-08-04 17:08:39 INFO No conflicting addons detected
Test GPU Operator Helm Installation :: Install GPU operator via He... 2026-08-04 17:08:40 INFO Added harvesterhci.io/gpu-baremetal-workloads=true to node dell-190-gpu
.2026-08-04 17:08:41 INFO Created HelmChart 'gpu-operator' in namespace 'kube-system'
.2026-08-04 17:08:41 INFO HelmChart 'gpu-operator' install job: helm-install-gpu-operator
2026-08-04 17:08:42 INFO Waiting for HelmChart job 'helm-install-gpu-operator' to complete…
2026-08-04 17:08:45 INFO Waiting for HelmChart job 'helm-install-gpu-operator' to complete…
2026-08-04 17:08:49 INFO HelmChart install job 'helm-install-gpu-operator' completed
.2026-08-04 17:08:49 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:08:53 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:08:56 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:00 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:03 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:07 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:10 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:14 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:17 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:21 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:25 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:29 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:32 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:36 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:40 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:43 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:47 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:51 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:54 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:09:58 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:02 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:05 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:09 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:13 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:16 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:20 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:24 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:27 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:31 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:35 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:39 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:42 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:46 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:50 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:53 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:10:57 INFO Waiting for GPU daemonset pods to appear: ['nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:11:01 INFO Waiting for GPU daemonset pods to appear: ['nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:11:04 INFO Waiting for GPU daemonset pods to appear: ['nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:11:08 INFO Waiting for GPU daemonset pods to appear: ['nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:11:12 INFO Waiting for GPU daemonset pods to appear: ['nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:11:15 INFO Waiting for GPU daemonset pods to appear: ['nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:11:19 INFO Waiting for GPU daemonset pods to appear: ['nvidia-operator-validator']…
2026-08-04 17:11:23 INFO Waiting for GPU daemonset pods to appear: ['nvidia-operator-validator']…
2026-08-04 17:11:26 INFO Waiting for GPU daemonset pods to appear: ['nvidia-operator-validator']…
2026-08-04 17:11:30 INFO GPU daemonset pod ready — nvidia-driver-daemonset-6.12.0-160000.35-default-sles16.0-tmhvq=Running
2026-08-04 17:11:30 INFO GPU daemonset pod ready — nvidia-container-toolkit-daemonset-hwqz9=Running
2026-08-04 17:11:30 INFO GPU daemonset pod ready — nvidia-operator-validator-wtmw7=Running
2026-08-04 17:11:30 INFO GPU daemonset pod ready — nvidia-device-plugin-daemonset-hz57l=Running
2026-08-04 17:11:30 INFO All GPU Operator pods in 'gpu-operator' are ready
Test GPU Operator Helm Installation :: Install GPU operator via He... | PASS |
------------------------------------------------------------------------------
Test GPU Node Discovery And CUDA Validation :: Discover GPU nodes;... 2026-08-04 17:11:31 INFO GPU node found: {'name': 'dell-190-gpu', 'gpus': '1'}
.....2026-08-04 17:11:31 INFO Created pod 'cuda-vectoradd' in namespace 'default'
.2026-08-04 17:11:31 INFO Pod 'cuda-vectoradd' phase=Pending, waiting…
2026-08-04 17:11:35 INFO Pod 'cuda-vectoradd' phase=Running, waiting…
2026-08-04 17:11:38 INFO Pod 'cuda-vectoradd' succeeded
.2026-08-04 17:11:38 INFO Logs for pod 'cuda-vectoradd':
[Vector addition of 50000 elements]
Copy input data from the host memory to the CUDA device
CUDA kernel launch with 196 blocks of 256 threads
Copy output data from the CUDA device to the host memory
Test PASSED
Done

2026-08-04 17:11:38 INFO CUDA vectoradd output verified
Test GPU Node Discovery And CUDA Validation :: Discover GPU nodes;... | PASS |
------------------------------------------------------------------------------
2026-08-04 17:11:38 INFO Deleted pod 'cuda-vectoradd' from namespace 'default'
2026-08-04 17:11:41 INFO Deleting HelmChart 'gpu-operator' from namespace 'kube-system'
2026-08-04 17:11:42 INFO Deleted HelmChart 'gpu-operator' from namespace 'kube-system'
2026-08-04 17:16:53 INFO HelmChart 'gpu-operator' fully removed
2026-08-04 17:16:54 INFO Removed harvesterhci.io/gpu-baremetal-workloads from node dell-190-gpu
2026-08-04 17:16:54 INFO Cleaning up test VMs
2026-08-04 17:16:55 INFO Cleaning up test volumes
2026-08-04 17:16:55 INFO Cleaning up test images
2026-08-04 17:16:56 INFO Cleaning up test vlan networks
2026-08-04 17:16:57 INFO Cleaning up test vlan configs
2026-08-04 17:16:57 INFO Cleaning up test cluster networks
2026-08-04 17:16:58 INFO Cleanup backups requested
Test Gpu Operator :: GPU Operator Test Cases Installs the NVIDIA G... | PASS |
2 tests, 2 passed, 0 failed
==============================================================================
Example B - don't detect a gpu on the node
Test GPU Operator Helm Installation :: Install GPU operator via He... 2026-08-04 17:44:25 INFO Added harvesterhci.io/gpu-baremetal-workloads=true to node hp-54-tink-system
.2026-08-04 17:44:26 INFO Created HelmChart 'gpu-operator' in namespace 'kube-system'
.2026-08-04 17:44:26 INFO HelmChart 'gpu-operator' install job: helm-install-gpu-operator
2026-08-04 17:44:27 INFO Waiting for HelmChart job 'helm-install-gpu-operator' to complete…
2026-08-04 17:44:30 INFO Waiting for HelmChart job 'helm-install-gpu-operator' to complete…
2026-08-04 17:44:34 INFO Waiting for HelmChart job 'helm-install-gpu-operator' to complete…
2026-08-04 17:44:37 INFO HelmChart install job 'helm-install-gpu-operator' completed
[ WARN ] WARNING: GPU daemonset pods ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset'] did not appear within 300s — no GPU hardware detected on this cluster.
Test GPU Operator Helm Installation :: Install GPU operator via He... 2026-08-04 17:44:37 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:44:41 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:44:44 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:44:48 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:44:51 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:44:55 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:44:58 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:02 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:05 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:09 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:12 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:16 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:19 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:23 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:26 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:30 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:33 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:37 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:40 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:44 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:47 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:51 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:55 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:45:58 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:02 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:05 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:09 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:12 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:16 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:19 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:23 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:26 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:30 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:33 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:37 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:40 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:44 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:47 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:51 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:54 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:46:58 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:01 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:05 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:08 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:12 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:15 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:19 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:22 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:26 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:29 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:33 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:36 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:40 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:47:43 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:49:20 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:49:24 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:49:27 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:49:31 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:49:34 INFO Waiting for GPU daemonset pods to appear: ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset']…
2026-08-04 17:49:38 WARNING WARNING: GPU daemonset pods ['nvidia-driver-daemonset', 'nvidia-container-toolkit-daemonset', 'nvidia-operator-validator', 'nvidia-device-plugin-daemonset'] did not appear within 300s — no GPU hardware detected on this cluster.
Test GPU Operator Helm Installation :: Install GPU operator via He... | PASS |
------------------------------------------------------------------------------
[ WARN ] WARNING: No GPU nodes found in this cluster - CUDA workload test will be skipped
Test GPU Node Discovery And CUDA Validation :: Discover GPU nodes;... | PASS |
No GPU nodes detected; skipping CUDA workload validation
------------------------------------------------------------------------------
2026-08-04 17:49:39 INFO Deleting HelmChart 'gpu-operator' from namespace 'kube-system'
2026-08-04 17:49:40 INFO Deleted HelmChart 'gpu-operator' from namespace 'kube-system'
2026-08-04 17:54:52 INFO HelmChart 'gpu-operator' fully removed
2026-08-04 17:54:53 INFO Removed harvesterhci.io/gpu-baremetal-workloads from node hp-54-tink-system
2026-08-04 17:54:53 INFO Cleaning up test VMs
2026-08-04 17:54:54 INFO Cleaning up test volumes
2026-08-04 17:54:55 INFO Cleaning up test images
2026-08-04 17:54:56 INFO Cleaning up test vlan networks
2026-08-04 17:54:56 INFO Cleaning up test vlan configs
2026-08-04 17:54:57 INFO Cleaning up test cluster networks
2026-08-04 17:54:58 INFO Cleanup backups requested
Test Gpu Operator :: GPU Operator Test Cases Installs the NVIDIA G... | PASS |
2 tests, 2 passed, 0 failed

Additional documentation or context

@Yu-Jack Yu-Jack self-assigned this Aug 4, 2026
@Yu-Jack
Yu-Jack force-pushed the test-2596 branch 5 times, most recently from 35b5149 to a036873 Compare August 4, 2026 09:48
@Yu-Jack
Yu-Jack marked this pull request as ready for review August 4, 2026 10:00
Signed-off-by: Jack Yu <jack.yu@suse.com>
@khushboo-rancher
khushboo-rancher requested a review from a team August 5, 2026 19:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant