RHCOS BFB Build

This projects generates a Red Hat CoreOS (RHCOS) BFB image for the Nvidia BlueField DPU. It currently uses custome-coreos-disk-images to generate the live artifacts.

Pre-requisites

Container image build requirements:

• Podman
• qemu-user-static-binfmt (needed for building on non-aarch64 machines)
• subscription-manager (Will enable podman to automount the subscription entitlements) BFB build requirements:
• Fedora aarch64 41 or later (Due to osbuild dependencies)
• skopeo
• SELinux disabled

Ensure your Fedora system has at least 50GB of storage.

[ $(df --output=avail / | tail -1) -lt 52428800 ] && echo "Warning: Less than 50GB available"

Ensure you are logged in to the Red Hat subscription manager

sudo dnf install subscription-manager
sudo subscription-manager register --username YOUR_USERNAME

Ensure dependencies are installed

sudo dnf install -y podman skopeo git 

sudo dnf install -y osbuild osbuild-tools osbuild-ostree jq xfsprogs 

Clone the project

The project contains Mellanox's bfscripts as a git submoudle, so be sure to clone it as well:

git clone --recursive https://github.com/rh-ecosystem-edge/rhcos-bfb-builder.git

First use an openshift cluster to check the release image for the RHCOS version you want to build.

export RHCOS_VERSION="4.20.0-ec.4"
export TARGET_IMAGE=$(oc adm release info --image-for rhel-coreos "quay.io/openshift-release-dev/ocp-release:"$RHCOS_VERSION"-aarch64")

Make sure you export PULL_SECRET, you can obtain it from https://console.redhat.com/openshift/install/pull-secret.

export PULL_SECRET=<path to pull secret file>

Set Nvidia DPU stack versions:

export DOCA_VERSION="3.1.0"
export DOCA_DISTRO="rhel9.6"

Build the container image:

podman build -f rhcos-bfb.Containerfile \
  --authfile $PULL_SECRET \
  --build-arg D_ARCH=aarch64 \
  --build-arg D_DOCA_VERSION=$DOCA_VERSION \
  --build-arg RHCOS_VERSION=$RHCOS_VERSION \
  --build-arg TARGET_IMAGE=$TARGET_IMAGE \
  --build-arg D_DOCA_DISTRO=$DOCA_DISTRO \
  --tag "rhcos-bfb:$RHCOS_VERSION-latest" .

Optionally, you can override the DOCA repository baseurl by adding: -build-arg D_DOCA_BASEURL=<custom_doca_repo_baseurl> to the above podman build command.

Creating disk boot images

skopeo copy containers-storage:localhost/rhcos-bfb:$RHCOS_VERSION-latest oci-archive:rhcos-bfb_$RHCOS_VERSION.ociarchive

You can follow the instructions at custom-coreos-disk-images to generate the live artifacts.

# In Fedora based system:
sudo dnf install -y osbuild osbuild-tools osbuild-ostree jq xfsprogs genisoimage
sudo custom-coreos-disk-images/custom-coreos-disk-images.sh \
  --ociarchive rhcos-bfb_$RHCOS_VERSION.ociarchive \
  --platforms live \
  --metal-image-size 5000

Creating a BFB image

./make_bfb.sh

Flashing to DPU

bfb-install --rshim /dev/rshim0 --config worker.ign --bfb rhcos.bfb