The QwQ-32B-preview model family, developed by Alibaba, consists of lightweight, open-source models that demonstrate state-of-the-art performance across various tasks.

This repo is about QwQ-32B-preview different size gguf models, which are very applicable for deploying and using in PCs, laptops or mobiles.

If you are a Mac user, the following free wonderful AI tools can help you to read and understand PDFs effectively:

  • If you are using Zotero for managing and reading your personal PDFs, PapersGPT is a free plugin which can assist you to chat PDFs effectively by your local gemma2.
  • you can download the beautiful ChatPDFLocal MacOS app from here, load one or batch PDF files at will, and quickly experience the effect of the model through chat reading. PS. Click here to subscribe or invite friends in ChatPDFLocal MacOS app can earn credits to use freely.
Downloads last month
50
GGUF
Model size
32.8B params
Architecture
qwen2

2-bit

3-bit

4-bit

Inference API
Unable to determine this model's library. Check the docs .