Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,593

Full-text search

Active filters: awq

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated Oct 9 • 3.81k • 6

jfiekdjdk/glm-4-9b-chat-awq

Updated Sep 15 • 14 • 1

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 21.9k • 28

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 1.93k • 3

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9 • 2.22k • 3

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9 • 14k • 6

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9 • 13.4k • 9

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9 • 31.1k • 38

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9 • 25.8k • 36

solidrust/LLama-3.1-8B-Matrix-AWQ

Text Generation • Updated Sep 19 • 26 • 1

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated about 3 hours ago • 20.1k • 7

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated Sep 26 • 624 • 1

lurker18/Llama_3.1_70B_AWQ_4bit

Updated Oct 4 • 335 • 1

hugging-quants/gemma-2-9b-it-AWQ-INT4

Text Generation • Updated 25 days ago • 1.95k • 4

peakji/steiner-32b-preview-awq

Updated 21 days ago • 57 • 3

Guilherme34/CODER-0.5b_awq

Text Generation • Updated 22 days ago • 13 • 1

IntervitensInc/LLAMA-3_8B_Unaligned_BETA-AWQ

Updated 21 days ago • 6 • 1

VAGOsolutions/SauerkrautLM-gemma-2-9b-it-awq

Updated 20 days ago • 2.9k • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated 12 days ago • 413 • 1

AMead10/SuperNova-Medius-AWQ

Text Generation • Updated 15 days ago • 162 • 2

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated about 6 hours ago • 2 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 35 • 3

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 26 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 16 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 17

casperhansen/opt-125m-awq

Text Generation • Updated Oct 31, 2023 • 889 • 2

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 27

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 10.7k • 20

TheBloke/Llama-2-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 785 • 16