Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

8,322

Full-text search

Active filters: gguf-my-repo

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • Updated 6 days ago • 3.95k • 25

pcuenq/Qwen2.5-0.5B-Instruct-with-new-merges-serialization-Q8_0-GGUF

Text Generation • Updated Sep 30 • 34 • 2

Orion-zhen/Meissa-Qwen2.5-14B-Instruct-Q6_K-GGUF

Updated 18 days ago • 322 • 2

CultriX/Qwen2.5-14B-MegaMerge-pt2-Q5_K_M-GGUF

Text Generation • Updated 18 days ago • 75 • 2

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

Updated 11 days ago • 917 • 12

NikolayKozloff/OpenCoder-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 3 days ago • 66 • 2

ggml-org/gemma-1.1-2b-it-Q8_0-GGUF

Updated Apr 5 • 1.16k • 1

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5 • 773 • 2

DavidAU/StoryWeaver-7b-Instruct-v0.1-Q6_K-GGUF

Updated Apr 10 • 14 • 2

DavidAU/Mistral-7B-Neural-Story-mix-Q6_K-GGUF

Updated Apr 10 • 26 • 1

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9 • 4.73k • 12

gate369/Bitnet-M7-70m-Q8_0-GGUF

Updated Apr 15 • 53 • 1

DavidAU/DistiLabelOrca-TinyLLama-1.1B-Q8_0-GGUF

Question Answering • Updated Apr 20 • 19 • 2

hus960/Llama-3-8b.UNLEASHED-Q4_K_M-GGUF

Text Generation • Updated Apr 23 • 12 • 2

DevsDoCode/LLama-3-8b-Uncensored-Q5_K_S-GGUF

Text Generation • Updated May 6 • 67 • 2

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated May 14 • 971 • 50

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3 • 2.08k • 50

Lanerdog/Llama-3-8B-Instruct-Gradient-1048k-Q5_K_M-GGUF

Text Generation • Updated May 21 • 7 • 1

AlirezaF138/Llama-3-Persian-8B-LoRA-Q6_K-GGUF

Updated May 22 • 51 • 5

Ayyystin/sexyGPT-Uncensored-Q4_0-GGUF

Updated Jun 7 • 847 • 2

zhaijunxiao/omost-llama-3-8b-Q8_0-GGUF

Updated Jun 12 • 89 • 4

sunzx0810/gte-Qwen2-7B-instruct-Q5_K_M-GGUF

Sentence Similarity • Updated Jun 25 • 422 • 6

mobeetle/Saul-7B-Instruct-v1-Q4_K_M-GGUF

Updated Jun 20 • 31 • 1

Johnyquest7/medllama3-v20-Q4_K_M-GGUF

Updated Jun 22 • 24 • 2

joaquinito2073/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Jul 1 • 27 • 1

huggingkot/dolphin-2.9.3-mistral-7B-32k-Q4_K_M-GGUF

Updated Jul 3 • 46 • 2

jorismathijssen/t5-base-Q4_K_M-GGUF

Translation • Updated Jul 8 • 28 • 1

mtsdurica/madlad400-3b-mt-Q4_K_M-GGUF

Translation • Updated Jul 13 • 9.87k • 3

xiaoshuai111/llama3-8b-Lawyer-v2-Q4_0-GGUF

Text Generation • Updated Jul 15 • 106 • 2

xiaoshuai111/lawyer-llama-13b-v2-Q4_0-GGUF

Updated Aug 28 • 202 • 3