metadata
datasets:
- PowerInfer/QWQ-LONGCOT-500K
- PowerInfer/LONGCOT-Refine-500K
base_model:
- PowerInfer/SmallThinker-3B-Preview
language:
- en
pipeline_tag: text-generation
tags:
- awq
- qwen2
- vllm
- 4bit
AWQ 4 bit, 128 groupsize of PowerInfer/SmallThinker-3B-Preview
Warning: This model seems to not work, not at least in my computer with vLLM