LLM Scaler is an GenAI solution for text generation, image generation, video generation etc running on Intel® Arc™ Pro B60 GPUs. LLM Scalar leverages standard frameworks such as vLLM, ComfyUI, Xinference etc and ensures the best performance for State-of-Art GenAI models running on Arc B60 GPUs.
llm-scaler-vllm supports running text generation models using vLLM:
llm-scaler-omni supports running image/voice/video generation etc using ComfyUI, Xinference:
- Please check out the Docker image releases for llm-scaler-vllm and llm-scaler-omni
- Please report a bug or raise a feature request by opening a Github Issue