How much GPU VRAM is needed for Qwen2.5 14B GGUF file?

#2
by JLouisBiz - opened

How much GPU VRAM is needed for Qwen2.5 14B GGUF file?

What token per hour can it give?

I see that model is excellent, thanks to Alibaba.com advancing the civilization with the free software, free as in freedom.

Sign up or log in to comment