Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

87

Full-text search

Active filters: llama.cpp

carsenk/llama3.2_1b_2025_uncensored

Text Generation • Updated 12 days ago • 1.01k • 2

mys/ggml_llava-v1.5-7b

Updated Oct 9, 2023 • 1.51k • 108

google/gemma-7b-GGUF

Updated Jun 27, 2024 • 5 • 18

google/gemma-2b-it-GGUF

Updated Jun 27, 2024 • 4 • 12

google/codegemma-2b-GGUF

Text Generation • Updated Jun 27, 2024 • 8 • 23

google/codegemma-7b-GGUF

Text Generation • Updated Jun 27, 2024 • 11 • 17

google/codegemma-7b-it-GGUF

Text Generation • Updated Jun 27, 2024 • 10 • 51

openbmb/MiniCPM-Llama3-V-2_5-gguf

Updated Aug 19, 2024 • 6.99k • 210

google/gemma-2-2b-it-GGUF

Updated Aug 27, 2024 • 552 • 78

google/gemma-2-2b-GGUF

Updated Aug 2, 2024 • 96 • 15

dahara1/llama-translate-gguf

Updated Aug 14, 2024 • 1.13k • 13

ghost-x/ghost-8b-beta-1608-gguf

Text Generation • Updated Aug 26, 2024 • 99 • 6

LPN64/LongCite-llama3.1-8b-GGUF

Text Generation • Updated Oct 1, 2024 • 147 • 6

dumb-dev/flan-t5-xxl-gguf

Updated Oct 29, 2024 • 783 • 10

Vikhrmodels/Vikhr-Qwen-2.5-1.5B-Instruct-GGUF

Updated Nov 26, 2024 • 720 • 4

JackCloudman/QwQ-32B-Preview-jackterated-GGUF

Text Generation • Updated Dec 3, 2024 • 5.57k • 4

phymbert/Phi-3.5-MoE-instruct-GGUF

Text Generation • Updated 15 days ago • 365 • 1

carsenk/llama3.2_3b_122824_uncensored

Text Generation • Updated 13 days ago • 454 • 1

Mozzipa/ko_vicuna_7b_ggml_q4

Updated Apr 20, 2023 • 4

ManthanKulakarni/JQL_LLaMa_GGML

Text Generation • Updated Jun 26, 2023 • 2

mys/ggml_llava-v1.5-13b

Updated Oct 10, 2023 • 607 • 53

mys/ggml_bakllava-1

Updated Oct 19, 2023 • 10.7k • 76

wasmedge/llama2

Text Generation • Updated Nov 11, 2023 • 69 • 8

alvarobartt/lince-zero-7b-GGUF

Text Generation • Updated Nov 1, 2023 • 4

vietgpt/dama-2-7b-chat-gguf

Text Generation • Updated Nov 17, 2023 • 3 • 1

FlexingD/yarn-mistral-7B-64k-instruct-alpaca-cleaned-GGUF

Updated Dec 4, 2023 • 88 • 5

jdluzen/Mistral-7B-Instruct-v0.2-GGUF

Updated Dec 24, 2023 • 7

jacobhoffmann/CodeLlama-13B-TestGen-Dart_v0.2-GGUF

Text Generation • Updated Dec 11, 2024 • 72

mostafaamiri/persian-llama-7b-GGUF-Q4

Updated Jan 13, 2024 • 132 • 9

ayoubkirouane/Mistral-Depth-UP-Scaled-9B-AlpacaInstruct-gguf

Text Generation • Updated Jan 24, 2024 • 11