Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

28,340

Full-text search

Active filters: 4-bit

mlx-community/DeepSeek-V3-0324-4bit

Text Generation • Updated 6 days ago • 629 • 28

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated 3 days ago • 2.68k • 21

FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit

Any-to-Any • Updated 3 days ago • 558 • 14

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated 2 days ago • 3.26k • 9

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated 9 days ago • 2.64k • 8

unsloth/Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 4 days ago • 2.32k • 6

Qwen/QwQ-32B-AWQ

Text Generation • Updated 20 days ago • 205k • 104

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.87M • 88

casperhansen/deepseek-r1-distill-qwen-7b-awq

Updated Feb 8 • 9.34k • 9

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 2 days ago • 53.8k • 74

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated about 7 hours ago • 49.4k • 18

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 24 days ago • 159k • 45

unsloth/QwQ-32B-unsloth-bnb-4bit

Text Generation • Updated 23 days ago • 26.9k • 36

LGAI-EXAONE/EXAONE-Deep-32B-AWQ

Text Generation • Updated 12 days ago • 1.45k • 14

infinitestack/tinyllama-sugarcane

Updated 7 days ago • 6 • 3

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 75.8k • 24

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 1.69M • 18

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 83.3k • 99

John6666/llama-joycaption-alpha-two-hf-llava-nf4

Image-Text-to-Text • Updated Jan 29 • 540 • 18

unsloth/Qwen2.5-Coder-32B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 1.27k • 5

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated Jan 13 • 72.7k • 51

mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit

Updated Feb 26 • 7.01k • 17

vital-ai/watt-tool-70B-awq

Updated Jan 24 • 98 • 2

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 879k • 2

unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Jan 31 • 2.72k • 7

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-4bit

Text Generation • Updated Feb 3 • 301 • 2

mlx-community/watt-tool-8B

Updated Feb 13 • 65 • 4

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated Feb 17 • 63.8k • 26

mlx-community/QwQ-32B-4bit

Text Generation • Updated 25 days ago • 5.87k • 35

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated 25 days ago • 389 • 2