Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

7,827

Full-text search

Active filters: imatrix

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated Sep 3 • 9.84k • 126

bartowski/Codestral-22B-v0.1-abliterated-v3-GGUF

Text Generation • Updated Jun 5 • 555 • 10

mradermacher/JailbrokeAI-i1-GGUF

Updated Aug 2 • 399 • 1

Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Aug 21 • 11.3k • 60

Qwen/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 21 • 9.09k • 167

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.22M • 10

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.2M • 9

bartowski/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 7 • 238 • 13

Lewdiculous/Hathor-L3-8B-v.01-GGUF-IQ-Imatrix

Updated Jun 7 • 153 • 6

mradermacher/Phoenix-i1-GGUF

Updated 10 days ago • 322 • 1

bartowski/dolphin-2.9.2-qwen2-72b-GGUF

Text Generation • Updated Jun 11 • 456 • 4

mradermacher/LLaMA2-13B-Psyfighter2-i1-GGUF

Updated Aug 2 • 110 • 2

duyntnet/pygmalion-2-7b-imatrix-GGUF

Text Generation • Updated Jun 13 • 334 • 1

mradermacher/L3-Umbral-Mind-RP-v2-8B-i1-GGUF

Updated 22 days ago • 190 • 3

mradermacher/Hathor_RP-v.01-L3-8B-i1-GGUF

Updated 10 days ago • 91 • 2

mradermacher/Samantha-Qwen2-7B-i1-GGUF

Updated 10 days ago • 186 • 2

legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF

Text Generation • Updated Jun 17 • 732 • 6

bartowski/DeepSeek-Coder-V2-Lite-Base-GGUF

Text Generation • Updated Jun 18 • 745 • 6

dreamgen/opus-v1.4-70b-llama3-gguf

Text Generation • Updated Jun 19 • 497 • 4

mradermacher/Storm-7B-i1-GGUF

Updated Aug 2 • 44 • 1

mradermacher/magnum-72b-v1-i1-GGUF

Updated 10 days ago • 471 • 10

mradermacher/DeepSeek-Coder-V2-Instruct-i1-GGUF

Updated Aug 2 • 13 • 6

arcee-ai/Llama-3-SEC-Chat-GGUF

Text Generation • Updated Jun 19 • 157 • 9

mradermacher/NeuralStar_Story-9b-i1-GGUF

Updated 11 days ago • 223 • 2

mradermacher/Domain-Fusion-L3-8B-i1-GGUF

Updated 10 days ago • 126 • 2

mradermacher/Prox-Llama-3-8B-i1-GGUF

Updated Aug 2 • 234 • 1

mradermacher/Hathor_Unstable-L3-8B-v0.3-i1-GGUF

Updated 10 days ago • 139 • 1

mradermacher/Hathor_Enigmatica-L3-8B-v0.4-i1-GGUF

Updated 10 days ago • 73 • 1

mradermacher/Tenebra_30B_Alpha01_FP16-i1-GGUF

Updated Aug 2 • 248 • 1

mradermacher/Llama3-Sophie-i1-GGUF

Updated 10 days ago • 120 • 2