Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,660

Full-text search

Active filters: 6-bit

MaziyarPanahi/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 3 • 574 • 1

MaziyarPanahi/SmolLM2-360M-Instruct-GGUF

Text Generation • Updated Nov 3 • 187 • 2

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • Updated Nov 6 • 6.38k • 1

MaziyarPanahi/Mistral-Crab-DPO-GGUF

Text Generation • Updated Nov 7 • 53 • 2

MaziyarPanahi/MN-Tiramisu-12B-GGUF

Text Generation • Updated Nov 7 • 117 • 1

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • Updated Nov 15 • 514 • 1

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • Updated Nov 15 • 385 • 2

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • Updated Nov 15 • 762 • 1

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • Updated Nov 15 • 118 • 1

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated Nov 15 • 227 • 7

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated Nov 20 • 675k • 1

mlx-community/Qwen2.5-Coder-32B-Instruct-6bit

Text Generation • Updated Nov 23 • 131 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_6.0bpw_h6

Updated about 1 month ago • 45 • 1

mlx-community/QwQ-32B-Preview-6bit

Text Generation • Updated 28 days ago • 140 • 4

imnotednamode/OuteTTS-0.2-500M-exl2-b6.0-hb8

Text-to-Speech • Updated 28 days ago • 34 • 1

mlx-community/INTELLECT-1-Instruct-6bit

Text Generation • Updated 24 days ago • 24 • 1

Dracones/QwQ-32B-Preview_exl2_6.0bpw

Text Generation • Updated 23 days ago • 27 • 1

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated 22 days ago • 696k • 3

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • Updated 21 days ago • 404 • 3

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • Updated 21 days ago • 479 • 2

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • Updated 20 days ago • 336 • 1

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • Updated 20 days ago • 169 • 1

mlx-community/Llama-3.3-70B-Instruct-6bit

Text Generation • Updated 19 days ago • 320 • 5

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated 18 days ago • 1.54M • 8

LoneStriker/Llama-3.3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated 19 days ago • 97 • 2

MaziyarPanahi/Pleias-Nano-GGUF

Text Generation • Updated 18 days ago • 339 • 3

MaziyarPanahi/EXAONE-3.5-2.4B-Instruct-GGUF

Text Generation • Updated 17 days ago • 335 • 1

MaziyarPanahi/EXAONE-3.5-7.8B-Instruct-GGUF

Text Generation • Updated 17 days ago • 219 • 1

MaziyarPanahi/EXAONE-3.5-32B-Instruct-GGUF

Text Generation • Updated 16 days ago • 237 • 1

MaziyarPanahi/Hermes-3-Llama-3.2-3B-GGUF

Text Generation • Updated 14 days ago • 410k • 1