Skip to content

Unable to get correct MTU for IPoIBNetwork #1664

@Giada2003

Description

@Giada2003

What happened/What you expected to happen:
I've deployed a IPoIBNetwork, but I'm unable to set the MTU value to the same as the Infiniband host interface (1496). Instead it defaults to 2044.

How to reproduce it (as minimally and precisely as possible):

Adding manually to the NetworkAttachmentDefinition the MTU setting doesn't help

apiVersion: mellanox.com/v1alpha1
kind: NicClusterPolicy
metadata:
  name: nic-cluster-policy
spec:
  rdmaSharedDevicePlugin:
    image: k8s-rdma-shared-dev-plugin
    repository: ghcr.io/mellanox
    version: v1.5.3
    imagePullSecrets: []
    config: |
      {
        "configList": [
          {
            "resourceName": "rdma_shared_device_a",
            "rdmaHcaMax": 63,
            "selectors": {
              "vendors": [],
              "deviceIDs": [],
              "drivers": [],
              "ifNames": ["ib0"],
              "linkTypes": []
            }
          }
        ]
      }
  secondaryNetwork:
    cniPlugins:
      image: plugins
      repository: ghcr.io/k8snetworkplumbingwg
      version: v1.6.2-update.1
      imagePullSecrets: []
    multus:
      image: multus-cni
      repository: ghcr.io/k8snetworkplumbingwg
      version: v4.2.2
      imagePullSecrets: []
    ipoib:
      image: ipoib-cni
      repository: ghcr.io/mellanox
      version: v1.2.2
    ipamPlugin:
      image: whereabouts
      repository: ghcr.io/k8snetworkplumbingwg
      version: v0.7.0
      imagePullSecrets: []
---
apiVersion: mellanox.com/v1alpha1
kind: IPoIBNetwork
metadata:
  name: ipoibnetwork
spec:
  networkNamespace: "rook-ceph"
  master: "ib0"
  ipam: |
    {
      "type": "whereabouts",
      "datastore": "kubernetes",
      "kubernetes": {
        "kubeconfig": "/etc/cni/net.d/whereabouts.d/whereabouts.kubeconfig"
      },
      "range": "172.16.0.0/24",
      "exclude": [
        "172.16.0.1/32"
      ],
      "log_file": "/var/log/whereabouts.log",
      "log_level": "info",
      "gateway": "172.16.0.1"
    }

Environment:

  • Network Operator version: 24.10.1
  • Kubernetes version (use kubectl version): 1.33.1
  • OS (e.g: cat /etc/os-release): AlmaLinux 9.5
  • CNI: Calico + Multus

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions