README.md

metadata

base_model: Felladrin/TinyMistral-248M-Evol-Instruct
datasets:
  - KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
inference: false
license: apache-2.0
model_creator: Felladrin
model_name: TinyMistral-248M-Evol-Instruct
pipeline_tag: text-generation
quantized_by: afrideva
tags:
  - autotrain
  - text-generation
  - gguf
  - ggml
  - quantized
  - q2_k
  - q3_k_m
  - q4_k_m
  - q5_k_m
  - q6_k
  - q8_0
widget:
  - text: |-
      ### Instruction:
      Which places do you recommend I visit around the world?

      ### Response:
  - text: |-
      ### Instruction:
      Write a story about some magical place.

      ### Response:
  - text: |-
      ### Instruction:
      Tell me all you know about the Earth.

      ### Response:

Felladrin/TinyMistral-248M-Evol-Instruct-GGUF

Quantized GGUF model files for TinyMistral-248M-Evol-Instruct from Felladrin

Name	Quant method	Size
tinymistral-248m-evol-instruct.q2_k.gguf	q2_k	115.26 MB
tinymistral-248m-evol-instruct.q3_k_m.gguf	q3_k_m	130.08 MB
tinymistral-248m-evol-instruct.q4_k_m.gguf	q4_k_m	155.67 MB
tinymistral-248m-evol-instruct.q5_k_m.gguf	q5_k_m	179.23 MB
tinymistral-248m-evol-instruct.q6_k.gguf	q6_k	204.26 MB
tinymistral-248m-evol-instruct.q8_0.gguf	q8_0	264.32 MB

Original Model Card:

Locutusque's TinyMistral-248M trained on the Evol Instruct dataset using AutoTrain

• Base model: Locutusque/TinyMistral-248M
• Dataset: KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
• Training: 9.5h under these parameters

Recommended Prompt Format

### Instruction:
<instruction>

### Response: