You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The model can output normally when run on the CPU using deepseek_r1_distill_llama_70b_q40. But using a GPU (AMD GPU) will result in abnormal output.May I ask how to adjust the GPU to ensure normal output.(GPU model:AMD RYZEN AI MAX+ 395 w/ Radeon 8060S)
Use GPU:
The model can output normally when run on the CPU using deepseek_r1_distill_llama_70b_q40. But using a GPU (AMD GPU) will result in abnormal output.May I ask how to adjust the GPU to ensure normal output.(GPU model:AMD RYZEN AI MAX+ 395 w/ Radeon 8060S)
Use GPU:
Use CPU: