Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

8,524

Full-text search

Active filters: llama-cpp

VlSav/Vikhr-Nemo-12B-Instruct-R-21-09-24-Q8_0-GGUF

Updated Sep 22 • 405 • 3

werty1248/Mistral-Nemo-NT-Ko-12B-dpo-GGUF

Updated Sep 25 • 24 • 3

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 6.9k • 14

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 3.18k • 13

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 214k • 15

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 61.5k • 40

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 11 • 1

aashish1904/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 18 • 1

jxtngx/Meta-Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 357 • 2

aashish1904/Llama-3.2-3B-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 83 • 1

polyverse/Llama-3.2-3B-Q5_K_M-GGUF

Text Generation • Updated Sep 25 • 19 • 1

netnk9151/Magnum-Picaro-0.7-v2-12b-Q8_0-GGUF

Text Generation • Updated Sep 26 • 15 • 1

Solshine/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated Sep 26 • 53 • 1

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 26 • 6 • 1

Orion-zhen/Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF

Text Generation • Updated Sep 26 • 495 • 2

beethogedeon/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Sep 26 • 6 • 1

Solshine/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 27 • 1

NikolayKozloff/T-lite-instruct-0.1-Q8_0-GGUF

Updated Sep 27 • 33 • 2

mylesgoose/Llama-3.2-3B-instruct-abliterated-Q8_0-GGUF

Updated Sep 27 • 1.4k • 3

djuna/L3.1-Purosani-Q5_K_M-GGUF

Updated Sep 27 • 1 • 1

polyverse/Llama-3.2-1B-Q5_K_M-GGUF

Text Generation • Updated Sep 27 • 30 • 1

darkc0de/Llama-3.2-3B-Instruct-abliterated-Q8_0-GGUF

Updated Sep 28 • 504 • 4

Orion-zhen/Meissa-Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 30 • 1.32k • 1

Thanabordee/openthaigpt1.5-7b-instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 30 • 113 • 3

TheDrunkenSnail/Lyra4-Gutenberg2-12B-Q4_K_M-GGUF

Updated Sep 30 • 13 • 1

v8karlo/Llama-3.2-3B-Instruct-uncensored-Q8_0-GGUF

Updated Oct 1 • 75 • 1

mashima/EZO-Humanities-9B-gemma-2-it-Q8_0-GGUF

Text Generation • Updated Oct 1 • 11 • 1

bunnycore/Qwen-2.5-3b-Evol-CoT-V3-IQ4_NL-GGUF

Updated Oct 1 • 22 • 1

hellork/law-chat-IQ4_XS-GGUF

Text Generation • Updated Oct 2 • 26 • 1

hellork/Indian_law_chat_minor_project-IQ4_XS-GGUF

Text2Text Generation • Updated Oct 2 • 4 • 1