lerobot/pi05_libero_base get's 0% success

[raul-machine-learning]

Ticket Type

🐛 Bug Report (Something isn't working)

Environment & System Info

$ uv run lerobot-info
- LeRobot version: 0.6.1
- Platform: Linux-6.8.0-124-generic-x86_64-with-glibc2.35
- Python version: 3.12.12
- Huggingface Hub version: 1.22.0
- Transformers version: 5.5.4
- Datasets version: 4.8.5
- Numpy version: 2.2.6
- FFmpeg version: 4.4.2-0ubuntu0.22.04.1
- PyTorch version: 2.11.0+cu128
- Torchcodec version: 0.11.1+cpu
- Is PyTorch built with CUDA support?: True
- Cuda version: 12.8
- GPU model: NVIDIA A100 80GB PCIe
- Using GPU in script?: <fill in>
- lerobot scripts: ['lerobot-annotate', 'lerobot-calibrate', 'lerobot-dataset-viz', 'lerobot-edit-dataset', 'lerobot-eval', 'lerobot-find-cameras', 'lerobot-find-joint-limits', 'lerobot-find-port', 'lerobot-imgtransform-viz', 'lerobot-info', 'lerobot-record', 'lerobot-replay', 'lerobot-rollout', 'lerobot-setup-can', 'lerobot-setup-motors', 'lerobot-teleoperate', 'lerobot-train', 'lerobot-train-tokenizer']

Description

Tried to evaluate this model: https://huggingface.co/lerobot/pi05_libero_base

All the outputs I am getting are like this:
https://github.com/user-attachments/assets/a0a33817-f0c3-4bfc-80d0-2a34eacbcd8b

Context & Reproduction

As suggested by the model's card I used:

$ uv run lerobot-eval \
--policy.path=lerobot/pi05_libero_base \
--env.type=libero \
--env.task=libero_object \
--eval.batch_size=1 \
--eval.n_episodes=20 \
--output_dir=./outputs/pi05_libero_eval 

Relevant logs or stack trace

Checklist

• I have searched existing tickets to ensure this isn't a duplicate.
• I am using the latest version of the main branch.
• I have verified this is not an environment-specific problem.

Additional Info / Workarounds

Thanks