Qwen
/

Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

Qwen2.5 quantization_benchmark

#2 opened 2 months ago by