zentorch 5.1 is the PyTorch plugin which comes with the ZenDNN 5.1 release. ZenDNN 5.1 continues to deliver inference performance for deep learning models on AMD EPYC™ CPUs, with a focus on optimizing large scale Recommender Systems. We've introduced several key optimizations to boost the performance of recommender models, such as DLRMv2.
The zentorch 5.1 plugin is optimized to be compatible with PyTorch 2.7 . In addition, zentorch is also integrated with vLLM. The new zentorch plugin for vLLM delivers a significant performance uplift of up to 21% on a variety of models compared to vLLM-IPEX.