Skip to content

feat(generation): remote vLLM/NIM generation backend (GPU-free) - #575

Draft
binaryaaron wants to merge 16 commits into
mainfrom
agonzales/remote-generation-backend
Draft

feat(generation): remote vLLM/NIM generation backend (GPU-free)#575
binaryaaron wants to merge 16 commits into
mainfrom
agonzales/remote-generation-backend