larenspear
/

dolphin-2.9.3-mistral-7B-32k-GGUF

Inference Endpoints

Model card Files Files and versions Community

dolphin-2.9.3-mistral-7B-32k-GGUF

1 contributor

History: 2 commits

larenspear's picture

GGUF Quantization

7e59d66 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
dolphin-2.9.3-mistral-7b-32k-q2_k.gguf

2.72 GB
LFS

GGUF Quantization 7 months ago
dolphin-2.9.3-mistral-7b-32k-q3_k_l.gguf

3.83 GB
LFS

GGUF Quantization 7 months ago
dolphin-2.9.3-mistral-7b-32k-q3_k_m.gguf

3.52 GB
LFS

GGUF Quantization 7 months ago
dolphin-2.9.3-mistral-7b-32k-q3_k_s.gguf

3.17 GB
LFS

GGUF Quantization 7 months ago
dolphin-2.9.3-mistral-7b-32k-q4_k_m.gguf

4.37 GB
LFS

GGUF Quantization 7 months ago
dolphin-2.9.3-mistral-7b-32k-q4_k_s.gguf

4.14 GB
LFS

GGUF Quantization 7 months ago
dolphin-2.9.3-mistral-7b-32k-q5_k_m.gguf

5.14 GB
LFS

GGUF Quantization 7 months ago
dolphin-2.9.3-mistral-7b-32k-q5_k_s.gguf

5 GB
LFS

GGUF Quantization 7 months ago
dolphin-2.9.3-mistral-7b-32k-q6_k.gguf

5.95 GB
LFS

GGUF Quantization 7 months ago
dolphin-2.9.3-mistral-7b-32k-q8_0.gguf

7.7 GB
LFS

GGUF Quantization 7 months ago