2 nearly identically topologies, different results. Not sure if either Antimony or Containerlab issue.

[prophet-60091]

I have an issue that is driving me crazy and I can't seem to figure out what's happening. I'm using Containerlab v0.69.3 with Antimony as a GUI overlay.

I created both topologies inside of the Antimony GUI.
Both topologies deploy successfully and are assigned IP space within c-lab's network.
One topology shows "orange" in Antimony and you can't right click and open a shell,
the other topology shows "green" and everything works as expected.
The nodes on the orange topology are there and I can "docker exec" into them, but they have no IPs assigned, even though c-labs log says they were assigned.

Both topologies are using exactly the same kinds of nodes with exactly the same image. (ceos:4.32.0F) Both have 11 nodes, so I don't think it's an issue with server resources. Both topologies have no start-up config.

I was thinking it might be a name-space issue because I had previously configured a topology with similar named nodes as a different user, but I've tried wiping every trace of that.

Here is everything I've tried:

# Stop/removed any clab containers
docker ps -a | grep clab- | awk '{print $1}' | xargs -r docker rm -f

# Removed stale networks
docker network ls | grep clab | awk '{print $1}' | xargs -r docker network rm

# Removed stale volumes
docker volume ls | grep clab- | awk '{print $2}' | xargs -r docker volume rm

# Cleaned up veth pairs (CAREFUL - this deletes clab interfaces only)
ip -o link show | awk -F': ' '/clab-/ {print $2}' | while read i; do sudo ip link delete $i; done

# Removed stale /etc/hosts entries
sudo sed -i '/clab-/d' /etc/hosts

I've checked ownership permissions.
I've tried deploying without any endpoint links
I've tried creating new collections

Nothing seems to work for this topology if the node names are slightly similar to previous node names.

Here is some relevant conf and log output, first from the NON-working topology and then from the WORKING topology:

################ NOT WORKING ###############

name: new-lab
topology:
  kinds:
    arista_ceos:
      image: ceos:4.32.0F
  nodes:
    REU-iedge:
      kind: arista_ceos
      labels:
        graph-posX: -79.95
        graph-posY: -212.24
    REU-Core-1:
      kind: arista_ceos
      labels:
        graph-posX: -83.31
        graph-posY: -33.4
    REU-Core-2:
      kind: arista_ceos
      labels:
        graph-posX: -82.34
        graph-posY: 130.95
    REI-iedge:
      kind: arista_ceos
      labels:
        graph-posX: 182.35
        graph-posY: -205.95
    REI-Core-1:
      kind: arista_ceos
      labels:
        graph-posX: 176.04
        graph-posY: -34.3
    REI-Core-2:
      kind: arista_ceos
      labels:
        graph-posX: 172.96
        graph-posY: 134.18
    H-BB1-1:
      kind: arista_ceos
      labels:
        graph-posX: -404.26
        graph-posY: 263.6
    H-BB1-2:
      kind: arista_ceos
      labels:
        graph-posX: -407.17
        graph-posY: 442.04
    H-Cust-1:
      kind: arista_ceos
      labels:
        graph-posX: -597.86
        graph-posY: 261.37
    G-BB1-1:
      kind: arista_ceos
      labels:
        graph-posX: -199.91
        graph-posY: 256.72
    G-BB1-2:
      kind: arista_ceos
      labels:
        graph-posX: -201.45
        graph-posY: 450.57
  links:
    - endpoints:
        - "REU-Core-1:eth23"
        - "REU-Core-2:eth23"
    - endpoints:
        - "REU-Core-1:eth24"
        - "REU-Core-2:eth24"
    - endpoints:
        - "REU-Core-1:eth2"
        - "REU-iedge:eth1"
    - endpoints:
        - "REU-Core-1:eth1"
        - "REI-Core-1:eth1"
    - endpoints:
        - "REU-Core-2:eth1"
        - "REI-Core-2:eth1"
    - endpoints:
        - "REI-Core-1:eth23"
        - "REI-Core-2:eth23"
    - endpoints:
        - "REI-Core-1:eth24"
        - "HN-RZREI-Core-2:eth24"
    - endpoints:
        - "EI-Core-1:eth2"
        - "REI-iedge:eth1"
    - endpoints:
        - "H-BB1-1:eth23"
        - "H-BB1-2:eth23"
    - endpoints:
        - "H-BB1-1:eth24"
        - "H-BB1-2:eth24"
    - endpoints:
        - "G-BB1-1:eth23"
        - "G-BB1-2:eth23"
    - endpoints:
        - "G-BB1-1:eth24"
        - "G-BB1-2:eth24"
    - endpoints:
        - "REU-Core-1:eth10"
        - "H-BB1-1:eth1"
    - endpoints:
        - "REU-Core-2:eth10"
        - "G-BB1-1:eth1"
    - endpoints:
        - "H-BB1-1:eth2"
        - "G-BB1-1:eth2"
    - endpoints:
        - "H-BB1-1:eth8"
        - "H-Cust-1:eth1"

clabs@containerlabs:~/clab-quickstart$ sudo docker ps
CONTAINER ID   IMAGE                                             COMMAND                  CREATED              STATUS                  PORTS                                                 NAMES
0aab35aa11a1   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-H-BB1-1
ebc01f6d599c   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-G-BB1-2
89b3f4df1a40   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-REU-Core-1
f99cfc318e7b   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-REU-iedge
9e286f64230b   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-H-BB1-2
7f47466aba54   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-REI-Core-2
2c30c9680af4   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-REU-Core-2
6777e8cf1564   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-REI-Core-1
951aab6d817e   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-REI-iedge
5b1cabc7b08b   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-G-BB1-1
355f4fb94b39   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-new-lab_1756887599301-H-Cust-1
533fa08bd5b4   ghcr.io/antimony-team/antimony-backend:latest     "./antimony-server -…"   19 hours ago         Up 19 hours                                                                   antimony_server
93bc0b480d1e   ghcr.io/antimony-team/antimony-interface:latest   "docker-entrypoint.s…"   19 hours ago         Up 19 hours             8100/tcp                                              antimony_interface
e533eb3f62d4   nginx:alpine                                      "/docker-entrypoint.…"   19 hours ago         Up 19 hours             172.21.0.52:8080->80/tcp, 172.21.0.52:8443->443/tcp   antimony_nginx
e4e6a489300c   postgres:15                                       "docker-entrypoint.s…"   4 days ago           Up 19 hours (healthy)                                                         antimony_database
9165affc429b   quay.io/keycloak/keycloak:25.0                    "/opt/keycloak/bin/k…"   4 days ago           Up 4 days               8443/tcp, 9000/tcp, 172.21.0.52:8081->8080/tcp        keycloak
1f928c483153   postgres:15                                       "docker-entrypoint.s…"   4 days ago           Up 4 days               5432/tcp                                              keycloak_db
clabs@containerlabs:~/clab-quickstart$ sudo docker network ls
NETWORK ID     NAME                DRIVER    SCOPE
86a96113d9ce   antimony_antimony   bridge    local
e2f17b7f171b   bridge              bridge    local
fd58844c8b8c   clab                bridge    local
00a6d8a28158   host                host      local
42c8daf7960a   none                null      local
clabs@containerlabs:~/clab-quickstart$ 

Containerlab deploy log:

08:19:59 ANTIMONY Starting deployment of lab id=c6899bde-889e-11f0-8c66-ae9317e97a6f instance=new-lab_1756887599301 topo=new-lab 
08:19:59 INFO Containerlab started version=0.69.3
08:19:59 INFO Parsing & checking topology file=topology.clab.yaml
08:19:59 INFO Creating docker network name=clab IPv4 subnet=172.20.20.0/24 IPv6 subnet=3fff:172:20:20::/64 MTU=1500
08:19:59 INFO Creating lab directory path=/app/run/c6899bde-889e-11f0-8c66-ae9317e97a6f/clab-new-lab_1756887599301
08:19:59 INFO Creating container name=H-Cust-1
08:19:59 INFO Creating container name=REI-Core-1
08:19:59 INFO Creating container name=REU-Core-2
08:19:59 INFO Creating container name=REI-iedge
08:19:59 INFO Creating container name=REI-Core-2
08:19:59 INFO Creating container name=G-BB1-1
08:19:59 INFO Creating container name=H-BB1-2
08:19:59 INFO Creating container name=REU-iedge
08:19:59 INFO Creating container name=H-BB1-1
08:19:59 INFO Creating container name=REU-Core-1
08:19:59 INFO Creating container name=G-BB1-2
08:20:00 ERRO failed deploy links for node "REI-Core-1": failed to Statfs "/proc/15390/ns/net": no such file or directory
08:20:00 ERRO failed deploy links for node "REU-iedge": failed to Statfs "/proc/15455/ns/net": no such file or directory
08:20:00 ERRO failed deploy links for node "H-BB1-2": failed to Statfs "/proc/15457/ns/net": no such file or directory
08:20:00 ERRO failed deploy links for node "H-BB1-1": failed to Statfs "/proc/15454/ns/net": no such file or directory
08:20:00 ERRO failed deploy links for node "REU-Core-2": failed to Statfs "/proc/15388/ns/net": no such file or directory
08:20:00 ERRO failed deploy links for node "REU-Core-1": file exists
08:20:00 ERRO failed deploy links for node "H-Cust-1": failed to Statfs "/proc/15709/ns/net": no such file or directory
08:20:00 ERRO failed deploy links for node "REI-iedge": file exists
08:20:00 ERRO failed deploy links for node "REI-Core-2": file exists
08:20:00 ERRO failed deploy links for node "G-BB1-2": failed to Statfs "/proc/15705/ns/net": no such file or directory
08:20:00 ERRO failed deploy links for node "G-BB1-1": file exists
08:20:00 INFO Adding host entries path=/etc/hosts
08:20:00 INFO Adding SSH config for nodes path=/etc/ssh/ssh_config.d/clab-new-lab_1756887599301.conf
You are on the latest version (0.69.3)
      ╭            ───────────────────────────────────────            ┬            ──────────────            ┬            ─────────            ┬            ───────────────────            ╮      
      │                              Name                             │              Kind/Image              │              State              │               IPv4/6 Address              │      
      ├            ───────────────────────────────────────            ┼            ──────────────            ┼            ─────────            ┼            ───────────────────            ┤      
│ clab-new-lab_1756887599301-G-BB1-1    │ arista_ceos  │ running │ 172.20.20.11      │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::b │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-G-BB1-2    │ arista_ceos  │ running │ 172.20.20.8       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::8 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-H-BB1-1    │ arista_ceos  │ running │ 172.20.20.5       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::5 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-H-BB1-2    │ arista_ceos  │ running │ 172.20.20.6       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::6 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-H-Cust-1   │ arista_ceos  │ running │ 172.20.20.9       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::9 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-REI-Core-1 │ arista_ceos  │ running │ 172.20.20.2       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::2 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-REI-Core-2 │ arista_ceos  │ running │ 172.20.20.12      │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::c │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-REI-iedge  │ arista_ceos  │ running │ 172.20.20.10      │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::a │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-REU-Core-1 │ arista_ceos  │ running │ 172.20.20.7       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::7 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-REU-Core-2 │ arista_ceos  │ running │ 172.20.20.3       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::3 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-new-lab_1756887599301-REU-iedge  │ arista_ceos  │ running │ 172.20.20.4       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::4 │
╰───────────────────────────────────────┴──────────────┴─────────┴───────────────────╯
08:20:00 INFO Parsing & checking topology file=topology.clab.yaml
08:20:01 ANTIMONY Deployment of lab was successful id=c6899bde-889e-11f0-8c66-ae9317e97a6f instance=new-lab_1756887599301 topo=new-lab 

Example device logs:

bash: line 1: /mnt/flash/if-wait.sh: No such file or directory
systemd 252-18.el9.Ar.1.227ec17_dfa8940 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
Detected virtualization docker.
Detected architecture x86-64.

Welcome to       [0;34mAlmaLinux 9.3 (Shamrock Pampas Cat)      [0m!

      [0;1;39m/usr/lib/systemd/system/xinetd.service:7: PIDFile= references a path below legacy directory /var/run/, updating /var/run/xinetd.pid → /run/xinetd.pid; please update the unit file accordingly.      [0m
Queued start job for default target Graphical Interface.
[      [0;32m  OK        [0m] Created slice       [0;1;39mSlice /system/modprobe      [0m.
[      [0;32m  OK        [0m] Created slice       [0;1;39mUser and Session Slice      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mLocal Encrypted Volumes      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mLocal Integrity Protected Volumes      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mRemote File Systems      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mSlice Units      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mSwaps      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mLocal Verity Protected Volumes      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mDevice-mapper event daemon FIFOs      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mLVM2 poll daemon socket      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mSyslog Socket      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mProcess Core Dump Socket      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39minitctl Compatibility Named Pipe      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mJournal Socket (/dev/log)      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mJournal Socket      [0m.
         Mounting       [0;1;39mHuge Pages File System      [0m...
         Mounting       [0;1;39mKernel Debug File System      [0m...
         Mounting       [0;1;39mKernel Trace File System      [0m...
         Starting       [0;1;39mProcess EosKernel cmdline      [0m...
         Starting       [0;1;39mLoad legacy module configuration      [0m...
         Starting       [0;1;39mMonitoring of LVM…meventd or progress polling      [0m...
         Starting       [0;1;39mLoad Kernel Module configfs      [0m...
         Starting       [0;1;39mLoad Kernel Module drm      [0m...
         Starting       [0;1;39mLoad Kernel Module fuse      [0m...
         Starting       [0;1;39mRead and set NIS …from /etc/sysconfig/network      [0m...
         Starting       [0;1;39mApply net.conf.ipv*.all workaround      [0m...
         Starting       [0;1;39mJournal Service      [0m...
         Starting       [0;1;39mLoad Kernel Modules      [0m...
         Starting       [0;1;39mGenerate network …ts from Kernel command line      [0m...
         Starting       [0;1;39mRemount Root and Kernel File Systems      [0m...
[      [0;32m  OK        [0m] Started       [0;1;39mJournal Service      [0m.
[      [0;32m  OK        [0m] Mounted       [0;1;39mHuge Pages File System      [0m.
[      [0;32m  OK        [0m] Mounted       [0;1;39mKernel Debug File System      [0m.
[      [0;32m  OK        [0m] Mounted       [0;1;39mKernel Trace File System      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mProcess EosKernel cmdline      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mLoad legacy module configuration      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mMonitoring of LVM… dmeventd or progress polling      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mLoad Kernel Module configfs      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mLoad Kernel Module drm      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mLoad Kernel Module fuse      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mRead and set NIS …e from /etc/sysconfig/network      [0m.
[      [0;1;31mFAILED      [0m] Failed to start       [0;1;39mLoad Kernel Modules      [0m.
See 'systemctl status systemd-modules-load.service' for details.
[      [0;32m  OK        [0m] Finished       [0;1;39mGenerate network units from Kernel command line      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mRemount Root and Kernel File Systems      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mPreparation for Network      [0m.
         Mounting       [0;1;39mFUSE Control File System      [0m...
         Mounting       [0;1;39mKernel Configuration File System      [0m...
         Starting       [0;1;39mArista stuff from rc.sysinit      [0m...
         Starting       [0;1;39mRebuild Hardware Database      [0m...
         Starting       [0;1;39mCreate System Users      [0m...
[      [0;32m  OK        [0m] Mounted       [0;1;39mFUSE Control File System      [0m.
[      [0;32m  OK        [0m] Mounted       [0;1;39mKernel Configuration File System      [0m.

############## WORKING ###################

name: test-topo
topology:
  kinds:
    arista_ceos:
      image: ceos:4.32.0F
  nodes:
    router1:
      kind: arista_ceos
      labels:
        graph-posX: 0
        graph-posY: 0
    router2:
      kind: arista_ceos
      labels:
        graph-posX: 308.46
        graph-posY: -5.19
    router3:
      kind: arista_ceos
      labels:
        graph-posX: -3
        graph-posY: 182.92
    router4:
      kind: arista_ceos
      labels:
        graph-posX: 315.11
        graph-posY: 177.24
    router5:
      kind: arista_ceos
      labels:
        graph-posX: -0.99
        graph-posY: 381.82
    router6:
      kind: arista_ceos
      labels:
        graph-posX: 308.81
        graph-posY: 381.39
    router7:
      kind: arista_ceos
      labels:
        graph-posX: -266.6
        graph-posY: 485.67
    router8:
      kind: arista_ceos
      labels:
        graph-posX: -78.02
        graph-posY: 487.67
    router9:
      kind: arista_ceos
      labels:
        graph-posX: -266.61
        graph-posY: 685.04
    router10:
      kind: arista_ceos
      labels:
        graph-posX: -75.7
        graph-posY: 683.21
    router11:
      kind: arista_ceos
      labels:
        graph-posX: -454.65
        graph-posY: 482.34
  links:
    - endpoints:
        - router1:eth1
        - router3:eth1
    - endpoints:
        - router2:eth1
        - router4:eth1
    - endpoints:
        - router4:eth2
        - router3:eth2
    - endpoints:
        - router3:eth3
        - router5:eth1
    - endpoints:
        - router4:eth3
        - router6:eth1
    - endpoints:
        - router6:eth2
        - router4:eth4
    - endpoints:
        - router5:eth2
        - router3:eth4
    - endpoints:
        - router5:eth3
        - router6:eth3
    - endpoints:
        - router7:eth1
        - router3:eth5
    - endpoints:
        - router5:eth4
        - router8:eth1
    - endpoints:
        - router8:eth2
        - router7:eth2
    - endpoints:
        - router7:eth3
        - router9:eth1
    - endpoints:
        - router7:eth4
        - router9:eth2
    - endpoints:
        - router8:eth3
        - router10:eth1
    - endpoints:
        - router8:eth4
        - router10:eth2
    - endpoints:
        - router7:eth5
        - router11:eth1

clabs@containerlabs:~/clab-quickstart$ sudo docker ps
CONTAINER ID   IMAGE                                             COMMAND                  CREATED              STATUS                  PORTS                                                 NAMES
1da750ba72b4   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router3
ddfc17b99540   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router5
03d9be3f58dc   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router4
2f11abb3d5bc   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router11
fb288b3b0e80   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router9
3873ae18b566   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router8
d285934f8986   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router7
9edcbd49de40   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router10
3a866fd93aaf   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router2
868bc6813afe   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router6
106d00a25660   ceos:4.32.0F                                      "bash -c '/mnt/flash…"   About a minute ago   Up About a minute                                                             clab-test-topo_1756888694486-router1
533fa08bd5b4   ghcr.io/antimony-team/antimony-backend:latest     "./antimony-server -…"   19 hours ago         Up 19 hours                                                                   antimony_server
93bc0b480d1e   ghcr.io/antimony-team/antimony-interface:latest   "docker-entrypoint.s…"   19 hours ago         Up 19 hours             8100/tcp                                              antimony_interface
e533eb3f62d4   nginx:alpine                                      "/docker-entrypoint.…"   19 hours ago         Up 19 hours             172.21.0.52:8080->80/tcp, 172.21.0.52:8443->443/tcp   antimony_nginx
e4e6a489300c   postgres:15                                       "docker-entrypoint.s…"   4 days ago           Up 20 hours (healthy)                                                         antimony_database
9165affc429b   quay.io/keycloak/keycloak:25.0                    "/opt/keycloak/bin/k…"   4 days ago           Up 4 days               8443/tcp, 9000/tcp, 172.21.0.52:8081->8080/tcp        keycloak
1f928c483153   postgres:15                                       "docker-entrypoint.s…"   4 days ago           Up 4 days               5432/tcp                                              keycloak_db
clabs@containerlabs:~/clab-quickstart$ sudo docker network ls
NETWORK ID     NAME                DRIVER    SCOPE
86a96113d9ce   antimony_antimony   bridge    local
e2f17b7f171b   bridge              bridge    local
6f28c4cdefe2   clab                bridge    local
00a6d8a28158   host                host      local
42c8daf7960a   none                null      local
clabs@containerlabs:~/clab-quickstart$ 

Containerlab logs:

08:38:14 ANTIMONY Starting deployment of lab id=5316481b-88a1-11f0-8c66-ae9317e97a6f instance=test-topo_1756888694486 topo=test-topo 
08:38:14 INFO Containerlab started version=0.69.3
08:38:14 INFO Parsing & checking topology file=topology.clab.yaml
08:38:14 INFO Creating docker network name=clab IPv4 subnet=172.20.20.0/24 IPv6 subnet=3fff:172:20:20::/64 MTU=1500
08:38:14 INFO Creating lab directory path=/app/run/5316481b-88a1-11f0-8c66-ae9317e97a6f/clab-test-topo_1756888694486
08:38:14 INFO Creating container name=router1
08:38:14 INFO Creating container name=router6
08:38:14 INFO Creating container name=router2
08:38:14 INFO Creating container name=router7
08:38:14 INFO Creating container name=router8
08:38:14 INFO Creating container name=router10
08:38:14 INFO Creating container name=router9
08:38:14 INFO Creating container name=router5
08:38:14 INFO Creating container name=router11
08:38:14 INFO Creating container name=router3
08:38:14 INFO Creating container name=router4
08:38:15 ERRO failed deploy links for node "router6": failed to Statfs "/proc/30488/ns/net": no such file or directory
08:38:15 ERRO failed deploy links for node "router4": failed to Statfs "/proc/30565/ns/net": no such file or directory
08:38:15 ERRO failed deploy links for node "router5": failed to Statfs "/proc/30500/ns/net": no such file or directory
08:38:15 ERRO failed deploy links for node "router7": failed to Statfs "/proc/30668/ns/net": no such file or directory
08:38:15 ERRO failed deploy links for node "router11": failed to Statfs "/proc/30693/ns/net": no such file or directory
08:38:15 ERRO failed deploy links for node "router8": failed to Statfs "/proc/30677/ns/net": no such file or directory
08:38:15 ERRO failed deploy links for node "router1": failed to Statfs "/proc/30815/ns/net": no such file or directory
08:38:15 ERRO failed deploy links for node "router3": file exists
08:38:15 ERRO failed deploy links for node "router10": failed to Statfs "/proc/30888/ns/net": no such file or directory
08:38:15 ERRO failed deploy links for node "router2": file exists
08:38:15 ERRO failed deploy links for node "router9": failed to Statfs "/proc/30790/ns/net": no such file or directory
08:38:16 INFO Adding host entries path=/etc/hosts
08:38:16 INFO Adding SSH config for nodes path=/etc/ssh/ssh_config.d/clab-test-topo_1756888694486.conf
You are on the latest version (0.69.3)
      ╭            ───────────────────────────────────────            ┬            ──────────────            ┬            ─────────            ┬            ───────────────────            ╮      
      │                              Name                             │              Kind/Image              │              State              │               IPv4/6 Address              │      
      ├            ───────────────────────────────────────            ┼            ──────────────            ┼            ─────────            ┼            ───────────────────            ┤      
│ clab-test-topo_1756888694486-router1  │ arista_ceos  │ running │ 172.20.20.9       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::9 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router10 │ arista_ceos  │ running │ 172.20.20.11      │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::b │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router11 │ arista_ceos  │ running │ 172.20.20.8       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::8 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router2  │ arista_ceos  │ running │ 172.20.20.7       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::7 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router3  │ arista_ceos  │ running │ 172.20.20.12      │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::c │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router4  │ arista_ceos  │ running │ 172.20.20.4       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::4 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router5  │ arista_ceos  │ running │ 172.20.20.3       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::3 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router6  │ arista_ceos  │ running │ 172.20.20.2       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::2 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router7  │ arista_ceos  │ running │ 172.20.20.5       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::5 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router8  │ arista_ceos  │ running │ 172.20.20.6       │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::6 │
├───────────────────────────────────────┼──────────────┼─────────┼───────────────────┤
│ clab-test-topo_1756888694486-router9  │ arista_ceos  │ running │ 172.20.20.10      │
│                                       │ ceos:4.32.0F │         │ 3fff:172:20:20::a │
╰───────────────────────────────────────┴──────────────┴─────────┴───────────────────╯
08:38:16 INFO Parsing & checking topology file=topology.clab.yaml
08:38:16 ANTIMONY Deployment of lab was successful id=5316481b-88a1-11f0-8c66-ae9317e97a6f instance=test-topo_1756888694486 topo=test-topo 

Example device logs:

bash: line 1: /mnt/flash/if-wait.sh: No such file or directory
systemd 252-18.el9.Ar.1.227ec17_dfa8940 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
Detected virtualization docker.
Detected architecture x86-64.

Welcome to       [0;34mAlmaLinux 9.3 (Shamrock Pampas Cat)      [0m!

      [0;1;39m/usr/lib/systemd/system/xinetd.service:7: PIDFile= references a path below legacy directory /var/run/, updating /var/run/xinetd.pid → /run/xinetd.pid; please update the unit file accordingly.      [0m
Queued start job for default target Graphical Interface.
[      [0;32m  OK        [0m] Created slice       [0;1;39mSlice /system/modprobe      [0m.
[      [0;32m  OK        [0m] Created slice       [0;1;39mUser and Session Slice      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mLocal Encrypted Volumes      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mLocal Integrity Protected Volumes      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mRemote File Systems      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mSlice Units      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mSwaps      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mLocal Verity Protected Volumes      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mDevice-mapper event daemon FIFOs      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mLVM2 poll daemon socket      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mSyslog Socket      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mProcess Core Dump Socket      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39minitctl Compatibility Named Pipe      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mJournal Socket (/dev/log)      [0m.
[      [0;32m  OK        [0m] Listening on       [0;1;39mJournal Socket      [0m.
         Mounting       [0;1;39mHuge Pages File System      [0m...
         Mounting       [0;1;39mKernel Debug File System      [0m...
         Mounting       [0;1;39mKernel Trace File System      [0m...
         Starting       [0;1;39mProcess EosKernel cmdline      [0m...
         Starting       [0;1;39mLoad legacy module configuration      [0m...
         Starting       [0;1;39mMonitoring of LVM…meventd or progress polling      [0m...
         Starting       [0;1;39mLoad Kernel Module configfs      [0m...
         Starting       [0;1;39mLoad Kernel Module drm      [0m...
         Starting       [0;1;39mLoad Kernel Module fuse      [0m...
         Starting       [0;1;39mRead and set NIS …from /etc/sysconfig/network      [0m...
         Starting       [0;1;39mApply net.conf.ipv*.all workaround      [0m...
         Starting       [0;1;39mJournal Service      [0m...
         Starting       [0;1;39mLoad Kernel Modules      [0m...
         Starting       [0;1;39mGenerate network …ts from Kernel command line      [0m...
         Starting       [0;1;39mRemount Root and Kernel File Systems      [0m...
[      [0;32m  OK        [0m] Started       [0;1;39mJournal Service      [0m.
[      [0;32m  OK        [0m] Mounted       [0;1;39mHuge Pages File System      [0m.
[      [0;32m  OK        [0m] Mounted       [0;1;39mKernel Debug File System      [0m.
[      [0;32m  OK        [0m] Mounted       [0;1;39mKernel Trace File System      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mProcess EosKernel cmdline      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mLoad legacy module configuration      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mMonitoring of LVM… dmeventd or progress polling      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mLoad Kernel Module configfs      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mLoad Kernel Module drm      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mLoad Kernel Module fuse      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mRead and set NIS …e from /etc/sysconfig/network      [0m.
[      [0;1;31mFAILED      [0m] Failed to start       [0;1;39mLoad Kernel Modules      [0m.
See 'systemctl status systemd-modules-load.service' for details.
[      [0;32m  OK        [0m] Finished       [0;1;39mGenerate network units from Kernel command line      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mRemount Root and Kernel File Systems      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mPreparation for Network      [0m.
         Mounting       [0;1;39mFUSE Control File System      [0m...
         Mounting       [0;1;39mKernel Configuration File System      [0m...
         Starting       [0;1;39mArista stuff from rc.sysinit      [0m...
         Starting       [0;1;39mRebuild Hardware Database      [0m...
         Starting       [0;1;39mCreate System Users      [0m...
[      [0;32m  OK        [0m] Mounted       [0;1;39mFUSE Control File System      [0m.
[      [0;32m  OK        [0m] Mounted       [0;1;39mKernel Configuration File System      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mApply net.conf.ipv*.all workaround      [0m.
         Starting       [0;1;39mApply Kernel Variables      [0m...
[      [0;32m  OK        [0m] Finished       [0;1;39mApply Kernel Variables      [0m.
[      [0;32m  OK        [0m] Finished       [0;1;39mCreate System Users      [0m.
[      [0;32m  OK        [0m] Reached target       [0;1;39mPreparation for Local File Systems      [0m.
         Mounting       [0;1;39m/.deltas      [0m...
         Mounting       [0;1;39m/monitor      [0m...
         Mounting       [0;1;39m/run/netns      [0m...
         Mounting       [0;1;39m/tmp for cEOS-lab      [0m...
         Mounting       [0;1;39m/var/core for cEOS-lab      [0m...
         Mounting       [0;1;39m/var/lib/docker for cEOS-lab      [0m...

[prophet-60091]

UPDATE: Apparently the issue was the "-" characters in my hostnames! I'm guessing the issue is the special significance - has in yaml? Eitherway, when I removed that everything worked.