Text Generation
GGUF
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
role play
128k context
llama3.2
Inference Endpoints
imatrix
conversational
Update README.md
Browse files
README.md
CHANGED
|
@@ -91,6 +91,10 @@ Due to the parameter count of this model, even IQ2s quants will work very well.
|
|
| 91 |
|
| 92 |
Q8 is not uploaded here because Imatrix has no effect on this quant.
|
| 93 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 94 |
<b>Optional Enhancement:</B>
|
| 95 |
|
| 96 |
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
|
|
|
|
| 91 |
|
| 92 |
Q8 is not uploaded here because Imatrix has no effect on this quant.
|
| 93 |
|
| 94 |
+
ARM QUANTS:
|
| 95 |
+
|
| 96 |
+
3 "ARM" quants have been added to the repo (23/10/2024). These quants are machine specific.
|
| 97 |
+
|
| 98 |
<b>Optional Enhancement:</B>
|
| 99 |
|
| 100 |
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
|