| datasets: | |
| - PowerInfer/QWQ-LONGCOT-500K | |
| - PowerInfer/LONGCOT-Refine-500K | |
| base_model: | |
| - PowerInfer/SmallThinker-3B-Preview | |
| language: | |
| - en | |
| pipeline_tag: text-generation | |
| tags: | |
| - awq | |
| - qwen2 | |
| - vllm | |
| - 4bit | |
| AWQ 4 bit, 128 groupsize of [PowerInfer/SmallThinker-3B-Preview](https://huggingface.co./PowerInfer/SmallThinker-3B-Preview) | |
| Warning: This model seems to not work, not at least in my computer with vLLM |