Cluster install status from Agent Rest API last seen was: installing

[aditi-sharma27]

OpenShift Assisted Installer Bootstrap Failure Report

The OpenShift cluster installation, performed using the Agent-based method consistently fails during the Bootstrap Phase. The installation times out repeatedly with the error "Bootstrap Kube API never initialized."
The logs indicate the process stalls at the "waiting for ETCD bootstrap to be complete" stage.

Cluster Environment Details

Component Value/Configuration
OpenShift Version 4.18.24
Installation Method Agent-based
Cluster Name dapoocp
Base Domain shift.com
Cluster nodes 3 (Master/Control Plane nodes)
Host Operating System CoreOS
Networking Plugin OVNKubernetes

DNS Configuration
The DNS entries
FQDN Record Type VIP/Target IP
api.dapoocp.shift.com A API_VIP
api-int.dapoocp.shift.com A API_VIP
*.apps.dapoocp.shift.com A (Wildcard) INGRESS_VIP
host1.shift.com A MASTER_IP_1
host2.shift.com A MASTER_IP_2
host3.shift.com A MASTER_IP_3

When I logged in to host1 which is RendezvousIP node also to check cluster. All the nodes, Pods and operators are healthy. and in openshift cluster list its coming as ready.

here is the logs of installation .openshift.logs

`time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Hostname host1.shift.com is unique in cluster"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Hostname host1.shift.com is allowed"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Speed of installation disk has not yet been measured"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Host is compatible with cluster platform baremetal"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Host agent is compatible with the service"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: No request to skip formatting of the installation disk"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: All disks that have skipped formatting are present in the host inventory"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Host is connected"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Media device is connected"
time="2025-11-19T09:27:28Z" level=warning msg="Host host1.shift.com validation: Machine Network CIDR is undefined; the Machine Network CIDR can be defined by
setting either the API or Ingress virtual IPs"
time="2025-11-19T09:27:28Z" level=trace msg="Host host1.shift.com validation: Missing inventory or machine network CIDR"
time="2025-11-19T09:27:28Z" level=trace msg="Host host1.shift.com validation: Not enough information to calculate host majority groups"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Platform PowerEdge R760 is allowed"
time="2025-11-19T09:27:28Z" level=warning msg="Host host1.shift.com validation: Host couldn't synchronize with any NTP server"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Host clock is synchronized with service"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: All required container images were either pulled successfully or no attempt was
made to pull them"
time="2025-11-19T09:27:28Z" level=trace msg="Host host1.shift.com validation: Missing network latency information."
time="2025-11-19T09:27:28Z" level=trace msg="Host host1.shift.com validation: Missing packet loss information."
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Host has been configured with at least one default route."
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Domain name resolution for the api.dapoocp.shift.com domain was successful or no
t required"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Domain name resolution for the api-int.dapoocp.shift.com domain was successful o
r not required"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Domain name resolution for the *.apps.dapoocp.shift.com domain was successful or
not required"
time="2025-11-19T09:27:28Z" level=trace msg="Host host1.shift.com validation: DNS wildcard check cannot be performed yet because the host has not yet performe
d DNS resolution"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: Host subnets are not overlapping"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: No IP collisions were detected by host 1263600e-38d3-2dc4-ed75-0b626d2b9bbd"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: cnv is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: lso is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: lvm is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: mce is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: mtv is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: node-feature-discovery is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: nvidia-gpu is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: odf is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: openshift-ai is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: pipelines is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: serverless is disabled"
time="2025-11-19T09:27:28Z" level=debug msg="Host host1.shift.com validation: servicemesh is disabled"
time="2025-11-19T09:27:28Z" level=info msg="Host host1.shift.com: updated status from discovering to pending-for-input (Waiting for user input: Host couldn't
synchronize with any NTP server ; Machine Network CIDR is undefined; the Machine Network CIDR can be defined by setting either the API or Ingress virtual IPs)
"
time="2025-11-19T09:27:36Z" level=info msg="Host host3.shift.com validation: Machine Network CIDR is defined"
time="2025-11-19T09:27:36Z" level=warning msg="Host host3.shift.com validation: No connectivity to the majority of hosts in the cluster"
time="2025-11-19T09:27:36Z" level=info msg="Host host1.shift.com validation: Machine Network CIDR is defined"
time="2025-11-19T09:27:36Z" level=warning msg="Host host1.shift.com validation: No connectivity to the majority of hosts in the cluster"
time="2025-11-19T09:27:36Z" level=info msg="Host host2.shift.com validation: Machine Network CIDR is defined"
time="2025-11-19T09:27:36Z" level=warning msg="Host host2.shift.com validation: No connectivity to the majority of hosts in the cluster"
time="2025-11-19T09:27:36Z" level=warning msg="Host host2.shift.com: updated status from pending-for-input to insufficient (Host cannot be installed due to following failing validation(s): Host couldn't synchronize with any NTP server ; No connectivity to the majority of hosts in the cluster)"
time="2025-11-19T09:27:42Z" level=info msg="Cluster is not ready for install. Check validations"
time="2025-11-19T09:27:42Z" level=warning msg="Cluster validation: api vips are not verified yet."
time="2025-11-19T09:27:42Z" level=warning msg="Cluster validation: ingress vips are not verified yet."
time="2025-11-19T09:27:42Z" level=info msg="Cluster validation: The Machine Network CIDR is defined."
time="2025-11-19T09:28:24Z" level=info msg="Host host1.shift.com validation: Host NTP is synced"
time="2025-11-19T09:28:24Z" level=info msg="Host host3.shift.com validation: Host NTP is synced"
time="2025-11-19T09:28:24Z" level=info msg="Host host2.shift.com: validation 'ntp-synced' is now fixed"
time="2025-11-19T09:28:26Z" level=info msg="Host host2.shift.com validation: Host NTP is synced"
time="2025-11-19T09:28:33Z" level=info msg="Cluster validation: api vips belongs to the Machine CIDR and is not in use."
time="2025-11-19T09:28:33Z" level=info msg="Cluster validation: ingress vips belongs to the Machine CIDR and is not in use."
time="2025-11-19T09:28:50Z" level=info msg="Host host2.shift.com validation: Host has connectivity to the majority of hosts in the cluster"
time="2025-11-19T09:28:50Z" level=info msg="Host host1.shift.com validation: Host has connectivity to the majority of hosts in the cluster"
time="2025-11-19T09:28:50Z" level=info msg="Host host3.shift.com validation: Host has connectivity to the majority of hosts in the cluster"
time="2025-11-19T09:28:50Z" level=info msg="Host host3.shift.com: updated status from insufficient to known (Host is ready to be installed)"
time="2025-11-19T09:28:54Z" level=info msg="Cluster is ready for install"
time="2025-11-19T09:28:54Z" level=info msg="Cluster validation: All hosts in the cluster are ready to install."
time="2025-11-19T09:28:58Z" level=info msg="Preparing cluster for installation"
time="2025-11-19T09:29:05Z" level=info msg="Host host3.shift.com: updated status from known to preparing-for-installation (Host finished successfully to prepare for installation)"
time="2025-11-19T09:29:46Z" level=info msg="Host host3.shift.com: New image status quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff2fce3ff36bee5334a9b8f7c85a85b06749909bc068861f54db14ea6144fee0. result: success. time: 3.40 seconds; size: 454.29 Megabytes; download rate: 140.23 MBps"
time="2025-11-19T09:29:51Z" level=info msg="Host host1.shift.com: New image status quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff2fce3ff36bee5334a9b8f7c85a85b06749909bc068861f54db14ea6144fee0. result: success. time: 3.61 seconds; size: 454.29 Megabytes; download rate: 131.84 MBps"
time="2025-11-19T09:29:53Z" level=info msg="Host host2.shift.com: updated status from preparing-for-installation to preparing-successful (Host finished successfully to prepare for installation)"
time="2025-11-19T09:30:03Z" level=info msg="Cluster installation in progress"
time="2025-11-19T09:30:10Z" level=info msg="Host host2.shift.com: updated status from preparing-successful to installing (Installation is in progress)"
time="2025-11-19T09:30:27Z" level=info msg="Host: host1.shift.com, reached installation stage Starting installation: bootstrap"
time="2025-11-19T09:30:29Z" level=info msg="Host: host3.shift.com, reached installation stage Writing image to disk"
time="2025-11-19T09:30:56Z" level=info msg="Host: host3.shift.com, reached installation stage Writing image to disk: 5%"
time="2025-11-19T09:31:21Z" level=info msg="Host: host1.shift.com, reached installation stage Writing image to disk: 5%"
time="2025-11-19T09:31:35Z" level=info msg="Host: host2.shift.com, reached installation stage Writing image to disk: 13%"
time="2025-11-19T09:32:26Z" level=info msg="Host: host1.shift.com, reached installation stage Writing image to disk: 10%"
time="2025-11-19T09:32:40Z" level=info msg="Host: host3.shift.com, reached installation stage Writing image to disk: 15%"

time="2025-11-19T09:43:48Z" level=info msg="Host: host1.shift.com, reached installation stage Writing image to disk: 63%"
time="2025-11-19T09:44:01Z" level=info msg="Host: host3.shift.com, reached installation stage Writing image to disk: 80%"
time="2025-11-19T09:44:11Z" level=info msg="Host: host2.shift.com, reached installation stage Writing image to disk: 83%"
time="2025-11-19T09:44:32Z" level=info msg="Host: host3.shift.com, reached installation stage Writing image to disk: 85%"
time="2025-11-19T09:44:34Z" level=info msg="Host: host1.shift.com, reached installation stage Writing image to disk: 68%"
time="2025-11-19T09:44:40Z" level=info msg="Host: host1.shift.com, reached installation stage Writing image to disk: 77%"
time="2025-11-19T09:44:59Z" level=info msg="Host: host2.shift.com, reached installation stage Writing image to disk: 88%"
time="2025-11-19T09:45:07Z" level=info msg="Host: host1.shift.com, reached installation stage Writing image to disk: 84%"
time="2025-11-19T09:45:28Z" level=info msg="Host: host3.shift.com, reached installation stage Writing image to disk: 90%"
time="2025-11-19T09:45:39Z" level=info msg="Host: host2.shift.com, reached installation stage Writing image to disk: 93%"
time="2025-11-19T09:45:56Z" level=info msg="Host: host2.shift.com, reached installation stage Writing image to disk: 100%"
time="2025-11-19T09:45:58Z" level=info msg="Host: host1.shift.com, reached installation stage Writing image to disk: 89%"
time="2025-11-19T09:46:07Z" level=info msg="Host: host3.shift.com, reached installation stage Writing image to disk: 100%"
time="2025-11-19T09:46:27Z" level=info msg="Host: host2.shift.com, reached installation stage Rebooting"
time="2025-11-19T09:46:36Z" level=info msg="Host: host3.shift.com, reached installation stage Rebooting"
time="2025-11-19T09:46:47Z" level=info msg="Host: host1.shift.com, reached installation stage Writing image to disk: 94%"
time="2025-11-19T09:46:53Z" level=info msg="Host: host1.shift.com, reached installation stage Writing image to disk: 100%"
time="2025-11-19T09:47:26Z" level=info msg="Host: host1.shift.com, reached installation stage Waiting for control plane: Waiting for masters to join bootstrap control plane"
time="2025-11-19T09:50:58Z" level=info msg="Host: host2.shift.com, reached installation stage Configuring"
time="2025-11-19T09:59:21Z" level=info msg="Host: host2.shift.com, reached installation stage Joined"
time="2025-11-19T09:59:25Z" level=info msg="Host: host1.shift.com, reached installation stage Waiting for bootkube"
time="2025-11-19T09:59:31Z" level=info msg="Host: host3.shift.com, reached installation stage Done"
time="2025-11-19T09:59:44Z" level=info msg="Node host2.shift.com has been rebooted 1 times before completing installation"
time="2025-11-19T09:59:46Z" level=info msg="Node host3.shift.com has been rebooted 1 times before completing installation"
time="2025-11-19T10:06:17Z" level=info msg="Host: host1.shift.com, reached installation stage Waiting for bootkube: waiting for ETCD bootstrap to be complete"
time="2025-11-19T10:06:21Z" level=info msg="Host: host1.shift.com, reached installation stage Waiting for controller: waiting for controller pod ready event"
time="2025-11-19T10:06:27Z" level=info msg="Host: host1.shift.com, reached installation stage Rebooting"
time="2025-11-19T10:07:27Z" level=debug msg="Bootstrap Kube API never initialized"
time="2025-11-19T10:07:27Z" level=debug msg="Cluster install status from Agent Rest API last seen was: installing"
time="2025-11-19T10:07:27Z" level=info msg="cluster bootstrap did not complete"
time="2025-11-19T10:07:29Z" level=debug msg="Bootstrap Kube API never initialized"
time="2025-11-19T10:07:29Z" level=debug msg="Cluster install status from Agent Rest API last seen was: installing"
time="2025-11-19T10:07:31Z" level=debug msg="Bootstrap Kube API never initialized"
time="2025-11-19T10:07:31Z" level=debug msg="Cluster install status from Agent Rest API last seen was: installing"
time="2025-11-19T10:07:33Z" level=debug msg="Bootstrap Kube API never initialized"
time="2025-11-19T10:07:33Z" level=debug msg="Cluster install status from Agent Rest API last seen was: installing"
time="2025-11-19T10:07:35Z" level=debug msg="Bootstrap Kube API never initialized"
time="2025-11-19T10:07:35Z" level=debug msg="Cluster install status from Agent Rest API last seen was: installing"
time="2025-11-19T10:07:37Z" leve`