Hugging Face's logo

afrideva
/
llama2_xs_460M_experimental_evol_instruct-GGUF

Text Generation
GGUF
Trained with AutoTrain
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
Model card Files Community
afrideva commited on
Commit
271a6a1
•
1 Parent(s): a7f4172

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -40,12 +40,12 @@ Quantized GGUF model files for [llama2_xs_460M_experimental_evol_instruct](https
40
 
41
  | Name | Quant method | Size |
42
  | ---- | ---- | ---- |
43
- | [llama2_xs_460m_experimental_evol_instruct.q2_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q2_k.gguf) | q2_k | None |
44
- | [llama2_xs_460m_experimental_evol_instruct.q3_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q3_k_m.gguf) | q3_k_m | None |
45
- | [llama2_xs_460m_experimental_evol_instruct.q4_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q4_k_m.gguf) | q4_k_m | None |
46
- | [llama2_xs_460m_experimental_evol_instruct.q5_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q5_k_m.gguf) | q5_k_m | None |
47
- | [llama2_xs_460m_experimental_evol_instruct.q6_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q6_k.gguf) | q6_k | None |
48
- | [llama2_xs_460m_experimental_evol_instruct.q8_0.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q8_0.gguf) | q8_0 | None |
49
 
50
 
51
 
 
40
 
41
  | Name | Quant method | Size |
42
  | ---- | ---- | ---- |
43
+ | [llama2_xs_460m_experimental_evol_instruct.q2_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q2_k.gguf) | q2_k | 212.56 MB |
44
+ | [llama2_xs_460m_experimental_evol_instruct.q3_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q3_k_m.gguf) | q3_k_m | 238.87 MB |
45
+ | [llama2_xs_460m_experimental_evol_instruct.q4_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q4_k_m.gguf) | q4_k_m | 288.52 MB |
46
+ | [llama2_xs_460m_experimental_evol_instruct.q5_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q5_k_m.gguf) | q5_k_m | 333.29 MB |
47
+ | [llama2_xs_460m_experimental_evol_instruct.q6_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q6_k.gguf) | q6_k | 380.87 MB |
48
+ | [llama2_xs_460m_experimental_evol_instruct.q8_0.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q8_0.gguf) | q8_0 | 492.67 MB |
49
 
50
 
51