Skip to content

[flex-attention] Fluctuations in results for individual shapes #5519

@Egor-Krivov

Description

@Egor-Krivov

On average chart is stable, but individual shapes have high variance. Maybe somewhere in a pytorch stack there is randomness in config choice?

Average chart:

Image

Individual chart
Image

Metadata

Metadata

Assignees

Type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions