Quantized from Qwen/Qwen2.5-14B-Instruct-1M down to 4 bits, GEMM.

Downloads last month: 217

Safetensors

Model size

3.33B params

Tensor type

I32

BF16

FP16

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for graelo/Qwen2.5-14B-Instruct-1M-AWQ

Base model

Qwen/Qwen2.5-14B

Finetuned

Qwen/Qwen2.5-14B-Instruct-1M

Quantized

(44)

this model