Hugging Face's logo

ross-dev
/
Monah-8b-Uncensored-gguf

Transformers
GGUF
English
llama
text-generation-inference
trl
sft
Inference Endpoints
conversational
Model card Files Community
1
Andrei Ross commited on
Commit
722cc2d
·
verified ·
1 Parent(s): f856149

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -63,15 +63,15 @@ The effectiveness and applicability of the model may be limited by its content d
63
 
64
  | Name | Quant method | Bits | Size | Max RAM required | Use case |
65
  | --- | --- | --- | --- | --- | --- |
66
- | SexyLlama-8b-gguf.Q2_K.gguf | Q2_K | 2 | 3.18 GB | 5.66 GB | significant quality loss - not recommended for most purpose |
67
- | SexyLlama-8b-gguf.Q3_K_M.gguf | Q3_K_M | 3 | 4.02 GB | 6.41 GB GB | very small, high quality loss |
68
- | SexyLlama-8b-gguf.Q4_K_S.gguf | Q4_K_S | 4 | 4.69 GB | 6.97 GB | small, greater quality loss |
69
- | SexyLlama-8b-gguf.Q4_K_M.gguf | Q4_K_M | 4 | 4.92 GB | 7.50 GB | medium, balanced quality - recommended |
70
- | SexyLlama-8b-gguf.Q5_0.gguf | Q5_0 | 5 | 5.6 GB | 7.63 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
71
- | SexyLlama-8b-gguf.Q5_K_S.gguf | Q5_K_S | 5 | 5.6 GB | 7.93 GB | large, low quality loss - recommended |
72
- | SexyLlama-8b-gguf.Q5_K_M.gguf | Q5_K_M | 5 | 5.73 GB | 8.20 GB | large, very low quality loss - recommended |
73
- | SexyLlama-8b-gguf.Q6_K.gguf | Q6_K | 6 | 6.60 GB | 8.97 GB | very large, extremely low quality loss |
74
- | SexyLlama-8b-gguf.F16 | F16 | 16 | 16.10 GB | 21.48 GB | very large, extremely low quality loss - not recommended |
75
 
76
 
77
  **WE ARE NOT RESPONSIBLE FOR MISUSE!!**
 
63
 
64
  | Name | Quant method | Bits | Size | Max RAM required | Use case |
65
  | --- | --- | --- | --- | --- | --- |
66
+ | Monah-8b-gguf.Q2_K.gguf | Q2_K | 2 | 3.18 GB | 5.66 GB | significant quality loss - not recommended for most purpose |
67
+ | Monah-8b-gguf.Q3_K_M.gguf | Q3_K_M | 3 | 4.02 GB | 6.41 GB GB | very small, high quality loss |
68
+ | Monah-8b-gguf.Q4_K_S.gguf | Q4_K_S | 4 | 4.69 GB | 6.97 GB | small, greater quality loss |
69
+ | Monah-8b-gguf.Q4_K_M.gguf | Q4_K_M | 4 | 4.92 GB | 7.50 GB | medium, balanced quality - recommended |
70
+ | Monah-8b-gguf.Q5_0.gguf | Q5_0 | 5 | 5.6 GB | 7.63 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
71
+ | Monah-8b-gguf.Q5_K_S.gguf | Q5_K_S | 5 | 5.6 GB | 7.93 GB | large, low quality loss - recommended |
72
+ | Monah-8b-gguf.Q5_K_M.gguf | Q5_K_M | 5 | 5.73 GB | 8.20 GB | large, very low quality loss - recommended |
73
+ | Monah-8b-gguf.Q6_K.gguf | Q6_K | 6 | 6.60 GB | 8.97 GB | very large, extremely low quality loss |
74
+ | Monah-8b-gguf.F16 | F16 | 16 | 16.10 GB | 21.48 GB | very large, extremely low quality loss - not recommended |
75
 
76
 
77
  **WE ARE NOT RESPONSIBLE FOR MISUSE!!**