Edit Models filters

Model Tree

google/gemma-2-9b-it

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

114

Full-text search

Active filters: google/gemma-2-9b-it

KingsonHO/gemma-2-9b-it-Q4_0-GGUF

Text Generation • Updated Jul 2 • 7

chenghenry/gemma-2-9b-it-GGUF

Updated Jul 4 • 5

e2jhiubyiiyvw/gemma-2-9b-it-Q5_K_M-GGUF

Text Generation • Updated Jul 3 • 4

zhezhe/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 16

martintomov/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Jul 8

qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF

Text Generation • Updated Jul 16 • 9

SanctumAI/gemma-2-9b-it-GGUF

Text Generation • Updated Sep 11 • 96.1k • 4

AI-Engine/gemma-2-9b-it-GGUF

Updated Jul 22 • 28

QuantFactory/gemma-2-9b-it-DPO-GGUF

Text Generation • Updated Jul 21 • 112 • 3

QuantFactory/gemma-2-9b-it-SimPO-GGUF

Updated Jul 27 • 438 • 2

QuantFactory/gemma-2-9b-it-SimPO-GGUF-v2

Updated Jul 21 • 253 • 3

backyardai/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 22 • 22

newsletter/gemma-2-9b-it-Q6_K-GGUF

Text Generation • Updated Jul 30 • 47

mlc-ai/gemma-2-9b-it-q0f16-MLC

Updated Aug 1 • 1

mlc-ai/gemma-2-9b-it-q3f16_1-MLC

Updated Aug 1 • 4 • 1

mlc-ai/gemma-2-9b-it-q4f32_1-MLC

Updated Aug 1 • 194

mlc-ai/gemma-2-9b-it-q4f16_1-MLC

Updated Aug 1 • 138

Kondara/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 1

joe-hirst/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 1 • 3

Xusilak/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Aug 2

dotsnangles/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 3

GPT4All-Community/gemma-2-9b-it-GGUF

Text Generation • Updated Aug 20 • 1.13k

illeatmyhat/gemma-2-9b-it-Q6_K-GGUF

Text Generation • Updated Aug 5

blogcncom/gemma-2-9b-it-Q4_0-GGUF

Text Generation • Updated Aug 6 • 4

neuralmagic/gemma-2-9b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 136 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 209 • 2

Sunny0624/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 19 • 2

NickTsaizer/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Aug 22 • 2

jacobcarajo/gemma-2-9b-it-Q5_K_M-GGUF

Text Generation • Updated Aug 22

QuantFactory/WoonaV1.2-9b-GGUF

Updated Aug 28 • 193 • 4