Hugging Face's logo

Kquant03
/
Prokaryote-8x7B-GGUF

GGUF
English
Merge
Mixture of Experts
Inference Endpoints
conversational
Model card Files Community
Kquant03 commited on
Commit
c9c42e5
·
verified ·
1 Parent(s): c4134cc

Upload 2 files

Browse files
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. ggml-model-q6_k.gguf +3 -0
  3. ggml-model-q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -39,3 +39,5 @@ ggml-model-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
39
  ggml-model-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
40
  ggml-model-q5_0.gguf filter=lfs diff=lfs merge=lfs -text
41
  ggml-model-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
39
  ggml-model-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
40
  ggml-model-q5_0.gguf filter=lfs diff=lfs merge=lfs -text
41
  ggml-model-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
42
+ ggml-model-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
43
+ ggml-model-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
ggml-model-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6576312991ed564bbdd073e333c58983876e087eca4ddb503132f95486529c5
3
+ size 38378759840
ggml-model-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af7623dc074b8d1b835f87832c4ef76f416c0d34ae49c2fa44ead0a27ff82422
3
+ size 49624262304