Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,830

Full-text search

Active filters: awq

wasertech/assistant-dolphin-2.2.1-mistral-7b-e1-awq

Text Generation • Updated Oct 29 • 36 • 2

TechxGenus/stable-code-3b-AWQ

Text Generation • Updated Apr 7 • 23 • 1

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • Updated Jul 5 • 3.33k • 35

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16 • 621 • 12

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 8.65k • 68

TechxGenus/Meta-Llama-3-8B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.53k • 4

TechxGenus/Meta-Llama-3-70B-AWQ

Text Generation • Updated Apr 19 • 90 • 6

solidrust/Einstein-v6.1-Llama3-8B-AWQ

Text Generation • Updated Sep 3 • 33 • 4

HuggingFaceM4/idefics2-8b-chatty-AWQ

Image-Text-to-Text • Updated May 6 • 46 • 5

NexaAIDev/Octopus-v2-gguf-awq

Text Generation • Updated Jun 23 • 1.99k • 7

solidrust/Llama-3-Lumimaid-8B-v0.1-OAS-AWQ

Text Generation • Updated Sep 3 • 33 • 1

palisaderesearch/Badllama-3-8B

Text Generation • Updated Nov 20 • 1

dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-awq

Text Generation • Updated Jun 27 • 26 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13 • 1.54k • 37

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 422k • 61

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 174k • 92

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27 • 56.5k • 8

RiversHaveWings/Meta-Llama-3.1-405B-AWQ

Text Generation • Updated Jul 24 • 33 • 6

TechxGenus/Mistral-Large-Instruct-2407-AWQ

Text Generation • Updated Oct 11 • 1.1k • 10

casperhansen/mistral-large-instruct-2407-awq

Text Generation • Updated Jul 25 • 1.03k • 4

iwaitu/llama-3.1-70b-chinese-chat-AWQ-4bit

Text Generation • Updated Aug 28 • 26 • 5

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29 • 109 • 3

arcee-ai/deepseek-v2-chat-0628-awq

Updated Aug 17 • 763 • 6

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 219k • 42

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21 • 6.16k • 18

thesven/Phi-3.5-mini-instruct-awq

Updated Aug 29 • 253 • 1

VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct-awq

Updated Sep 1 • 135 • 1

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2 • 84 • 3

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated Oct 9 • 240 • 6

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 2.48k • 5