afrideva commited on
Commit
233ca15
1 Parent(s): 032184c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +74 -0
README.md ADDED
@@ -0,0 +1,74 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Felladrin/TinyMistral-248M-Evol-Instruct
3
+ datasets:
4
+ - KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
5
+ inference: false
6
+ license: apache-2.0
7
+ model_creator: Felladrin
8
+ model_name: TinyMistral-248M-Evol-Instruct
9
+ pipeline_tag: text-generation
10
+ quantized_by: afrideva
11
+ tags:
12
+ - autotrain
13
+ - text-generation
14
+ - gguf
15
+ - ggml
16
+ - quantized
17
+ - q2_k
18
+ - q3_k_m
19
+ - q4_k_m
20
+ - q5_k_m
21
+ - q6_k
22
+ - q8_0
23
+ widget:
24
+ - text: '### Instruction:
25
+
26
+ Which places do you recommend I visit around the world?
27
+
28
+
29
+ ### Response:'
30
+ - text: '### Instruction:
31
+
32
+ Write a story about some magical place.
33
+
34
+
35
+ ### Response:'
36
+ - text: '### Instruction:
37
+
38
+ Tell me all you know about the Earth.
39
+
40
+
41
+ ### Response:'
42
+ ---
43
+ # Felladrin/TinyMistral-248M-Evol-Instruct-GGUF
44
+
45
+ Quantized GGUF model files for [TinyMistral-248M-Evol-Instruct](https://huggingface.co/Felladrin/TinyMistral-248M-Evol-Instruct) from [Felladrin](https://huggingface.co/Felladrin)
46
+
47
+
48
+ | Name | Quant method | Size |
49
+ | ---- | ---- | ---- |
50
+ | [tinymistral-248m-evol-instruct.fp16.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.fp16.gguf) | fp16 | 496.82 MB |
51
+ | [tinymistral-248m-evol-instruct.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q2_k.gguf) | q2_k | 115.26 MB |
52
+ | [tinymistral-248m-evol-instruct.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q3_k_m.gguf) | q3_k_m | 130.08 MB |
53
+ | [tinymistral-248m-evol-instruct.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q4_k_m.gguf) | q4_k_m | 155.67 MB |
54
+ | [tinymistral-248m-evol-instruct.q5_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q5_k_m.gguf) | q5_k_m | 179.23 MB |
55
+ | [tinymistral-248m-evol-instruct.q6_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q6_k.gguf) | q6_k | 204.26 MB |
56
+ | [tinymistral-248m-evol-instruct.q8_0.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q8_0.gguf) | q8_0 | 264.32 MB |
57
+
58
+
59
+
60
+ ## Original Model Card:
61
+ # Locutusque's TinyMistral-248M trained on the Evol Instruct dataset using AutoTrain
62
+
63
+ - Base model: [Locutusque/TinyMistral-248M](https://huggingface.co/Locutusque/TinyMistral-248M)
64
+ - Dataset: [KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format](https://huggingface.co/datasets/KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format)
65
+ - Training: 9.5h under [these parameters](https://huggingface.co/Felladrin/TinyMistral-248M-Evol-Instruct/blob/85723f768c439307c996328d68fe7df2947237ae/training_params.json)
66
+
67
+ ## Recommended Prompt Format
68
+
69
+ ```
70
+ ### Instruction:
71
+ <instruction>
72
+
73
+ ### Response:
74
+ ```