module 'xformers.ops.fmha' has no attribute 'BlockDiagonalMask

[langrenlaile]

module 'xformers.ops.fmha' has no attribute 'BlockDiagonalMask

[attashe]

You have the newer version of xformers than 0.0.27.post2. And you need to downgrade xformers version with

pip install xformers==0.0.27.post2

Or replace all mentions of xformers.ops.fmha.BlockDiagonalMask to xformers.ops.fmha.attn_bias.BlockDiagonalMask because this class was moved in last version

https://facebookresearch.github.io/xformers/components/ops.html#xformers.ops.fmha.attn_bias.BlockDiagonalMask