altomek
/

gemma-2-9b-8bpw-EXL2

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

gemma-2-9b

ExLlamav2 8 bpw quant of google https://huggingface.co./google/gemma-2-9b

Downloads last month: 8

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/gemma-2-9b-8bpw-EXL2

Base model

google/gemma-2-9b

Quantized

(45)

this model