adriabama06's picture
Update README.md
76d7f66 verified
|
raw
history blame
333 Bytes
metadata
datasets:
  - PowerInfer/QWQ-LONGCOT-500K
  - PowerInfer/LONGCOT-Refine-500K
base_model:
  - PowerInfer/SmallThinker-3B-Preview
language:
  - en
pipeline_tag: text-generation
tags:
  - awq
  - qwen2
  - vllm
  - 4bit

AWQ 4 bit, 128 groupsize of PowerInfer/SmallThinker-3B-Preview