Hugging Face's logo

pipilok
/
phi-4-unsloth-exl2-8bpw-hb8

Safetensors
llama
8-bit precision
exl2
Model card Files Community
1
pipilok commited on
Commit
7254843
·
verified ·
1 Parent(s): 7513663

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -2,8 +2,9 @@
2
  base_model:
3
  - unsloth/phi-4
4
  ---
5
-
6
- -- Quantization strategy:
 
7
  -- model.layers.0.self_attn 8.0414 bpw - exp. error: 0.00231304
8
  -- model.layers.0.mlp 8.0346 bpw - exp. error: 0.00221935
9
  -- model.layers.1.self_attn 8.0414 bpw - exp. error: 0.00190707
@@ -85,4 +86,5 @@ base_model:
85
  -- model.layers.39.self_attn 8.0414 bpw - exp. error: 0.00041204
86
  -- model.layers.39.mlp 8.0346 bpw - exp. error: 0.00097704
87
  -- sum(log(err)): -530.376730
88
- -- max(err): 0.003490
 
 
2
  base_model:
3
  - unsloth/phi-4
4
  ---
5
+
6
+ ```
7
+ -- Quantization strategy:
8
  -- model.layers.0.self_attn 8.0414 bpw - exp. error: 0.00231304
9
  -- model.layers.0.mlp 8.0346 bpw - exp. error: 0.00221935
10
  -- model.layers.1.self_attn 8.0414 bpw - exp. error: 0.00190707
 
86
  -- model.layers.39.self_attn 8.0414 bpw - exp. error: 0.00041204
87
  -- model.layers.39.mlp 8.0346 bpw - exp. error: 0.00097704
88
  -- sum(log(err)): -530.376730
89
+ -- max(err): 0.003490
90
+ ```