[Feature] enable AMX support for vLLM on GNR/EMR/SPR

[louie-tsai]

Priority

P3-Medium

OS type

Ubuntu

Hardware type

Xeon-GNR

Running nodes

Single Node

Description

Need to make use of AMX of GNR/EMR for vLLM on OPEA

• Enable Xeon optimizations like Tensor Parallel and AMX from vLLM 0.10.0 #2106

[louie-tsai]

#2106

[CICD-at-OPEA]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.