unsloth

/

DeepSeek-R1-Distill-Qwen-32B-unsloth-bnb-4bit

like 5

Follow

Unsloth AI 2.51k

Hi
after pull this to my disk, I tried "uv run vllm serve /data/ollama/qwen32R1"
and then it reports error, said that

assert param_data.shape == loaded_weight.shape
Assertion Error

why this happen? how can I fix that?