Hugging Face's logo

afrideva
/
TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF

Text Generation
GGUF
English
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
Model card Files Community
afrideva commited on
Commit
ccd1b5c
•
1 Parent(s): bcea237

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -29,12 +29,12 @@ Quantized GGUF model files for [TinyLlama-1.1B-intermediate-step-955k-token-2T](
29
 
30
  | Name | Quant method | Size |
31
  | ---- | ---- | ---- |
32
- | [tinyllama-1.1b-intermediate-step-955k-token-2t.q2_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q2_k.gguf) | q2_k | None |
33
- | [tinyllama-1.1b-intermediate-step-955k-token-2t.q3_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q3_k_m.gguf) | q3_k_m | None |
34
- | [tinyllama-1.1b-intermediate-step-955k-token-2t.q4_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q4_k_m.gguf) | q4_k_m | None |
35
- | [tinyllama-1.1b-intermediate-step-955k-token-2t.q5_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q5_k_m.gguf) | q5_k_m | None |
36
- | [tinyllama-1.1b-intermediate-step-955k-token-2t.q6_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q6_k.gguf) | q6_k | None |
37
- | [tinyllama-1.1b-intermediate-step-955k-token-2t.q8_0.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q8_0.gguf) | q8_0 | None |
38
 
39
 
40
 
 
29
 
30
  | Name | Quant method | Size |
31
  | ---- | ---- | ---- |
32
+ | [tinyllama-1.1b-intermediate-step-955k-token-2t.q2_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q2_k.gguf) | q2_k | 482.14 MB |
33
+ | [tinyllama-1.1b-intermediate-step-955k-token-2t.q3_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q3_k_m.gguf) | q3_k_m | 549.85 MB |
34
+ | [tinyllama-1.1b-intermediate-step-955k-token-2t.q4_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q4_k_m.gguf) | q4_k_m | 667.81 MB |
35
+ | [tinyllama-1.1b-intermediate-step-955k-token-2t.q5_k_m.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q5_k_m.gguf) | q5_k_m | 782.04 MB |
36
+ | [tinyllama-1.1b-intermediate-step-955k-token-2t.q6_k.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q6_k.gguf) | q6_k | 903.41 MB |
37
+ | [tinyllama-1.1b-intermediate-step-955k-token-2t.q8_0.gguf](https://huggingface.co/afrideva/TinyLlama-1.1B-intermediate-step-955k-token-2T-GGUF/resolve/main/tinyllama-1.1b-intermediate-step-955k-token-2t.q8_0.gguf) | q8_0 | 1.17 GB |
38
 
39
 
40