Distill Compatibility for PC w/ Ryzen 7 Pro 8840HS w/ 780M Graphics 2x32GB RAM 1TB DDR5 SSD
#115
by
arzx
- opened
Hello. Do you have any knowledge on which one would have a good performance (or would be at minimum recommendation, that would run smoothly) for a PC w/ Ryzen 7 Pro 8840HS w/ 780M Graphics 2x32GB RAM 1TB DDR5 SSD? I'm looking at these options (if can be recommended):
32b-qwen-distill-q4_K_M - 20GB
32b-qwen-distill-fp16 - 66GB
32b-qwen-distill-q8_0 - 35GB
Thanks.
ig you want real good performance, go for the 4bit quantized version.
or if you want some really good quality results, go for the full precision.
all in other ways, still code to the fact that. AMD may not provide the drivers for the integrated gpu