Skip to content

v1.0.9

Latest

Choose a tag to compare

@WarningRan WarningRan released this 17 Oct 14:41
· 4 commits to dev since this release
f241933

Bug Fix

infer/vllm/prometheus_metrics.py

  • Fixed an issue with post-processing of results when Prom metrics are enabled.
    • Removed extraneous debug print statements from the get_cpu_metrics, get_memory_metrics, and get_arguments functions to ensure the correct data flow after metric collection.