Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
tclf90
/
qwen2.5-72b-instruct-gptq-int4
like
0
Text Generation
Safetensors
qwen2
qwen2.5
gptq
int4
vLLM
sglang
conversational
4-bit precision
License:
qwen
Model card
Files
Files and versions
Community
Use this model
This is a mirror repo from modelscope tclf90/qwen2.5-72b-instruct-gptq-int4
This is a mirror repo from modelscope
tclf90/qwen2.5-72b-instruct-gptq-int4
Downloads last month
76
Safetensors
Model size
11.9B params
Tensor type
FP16
·
I32
·
Inference Examples
Text Generation
Unable to determine this model's library. Check the
docs
.
Model tree for
tclf90/qwen2.5-72b-instruct-gptq-int4
Base model
Qwen/Qwen2.5-72B
Finetuned
Qwen/Qwen2.5-72B-Instruct
Quantized
(
68
)
this model