Hugging Face's logo

ddh0
/
Qwen2.5-14B-All-Variants-q8_0-q6_K-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
ddh0 commited on
Commit
ef987c4
·
verified ·
1 Parent(s): b0eb0b7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -3
README.md CHANGED
@@ -1,3 +1,9 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - Qwen/Qwen2.5-14B
5
+ ---
6
+
7
+ # Qwen2.5-14B-All-Variants-q8_0-q6_K-GGUF
8
+
9
+ This repo contains GGUF quantizations of [Qwen/Qwen2.5-14B](https://huggingface.co/Qwen/Qwen2.5-14B), [Qwen/Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct), and [Qwen/Qwen2.5-Coder-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct) models at q6_K, using q8_0 for output and embedding tensors.