Hugging Face's logo

artificialguybr
/
QWEN-2.5-0.5B-Synthia-I-gguf

Transformers
GGUF
English
instruct
finetune
chatml
gpt4
synthetic data
distillation
Inference Endpoints
conversational
Model card Files Community

About

Thanks Redmond.AI for GPU Sponsor!

Quantization for: https://huggingface.co./artificialguybr/QWEN-2.5-0.5B-Synthia-I

How to use

If you are unsure how to use GGUF files, look at the TheBloke READMEs for more details, including on how to concatenate multi-part files.

Downloads last month
156
GGUF
Model size
630M params
Architecture
qwen2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

Model tree for artificialguybr/QWEN-2.5-0.5B-Synthia-I-gguf

Base model

Qwen/Qwen2.5-0.5B
Finetuned
artificialguybr/QWEN-2.5-0.5B-Synthia-I
Quantized
(3)
this model

Dataset used to train artificialguybr/QWEN-2.5-0.5B-Synthia-I-gguf