Hugging Face's logo

tensorblock
/
Mixtral-8x7B-v0.1-GGUF

GGUF
Mixture of Experts
TensorBlock
GGUF
Inference Endpoints
Model card Files Community
morriszms commited on
Commit
b08c8f2
·
verified ·
1 Parent(s): e89ab2a

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. Mixtral-8x7B-v0.1-Q2_K.gguf +2 -2
  2. Mixtral-8x7B-v0.1-Q3_K_L.gguf +2 -2
  3. Mixtral-8x7B-v0.1-Q3_K_M.gguf +2 -2
  4. Mixtral-8x7B-v0.1-Q3_K_S.gguf +2 -2
  5. Mixtral-8x7B-v0.1-Q4_0.gguf +2 -2
  6. Mixtral-8x7B-v0.1-Q4_K_M.gguf +2 -2
  7. Mixtral-8x7B-v0.1-Q4_K_S.gguf +2 -2
  8. Mixtral-8x7B-v0.1-Q5_0.gguf +2 -2
  9. Mixtral-8x7B-v0.1-Q5_K_M.gguf +2 -2
  10. Mixtral-8x7B-v0.1-Q5_K_S.gguf +2 -2
  11. Mixtral-8x7B-v0.1-Q6_K.gguf +2 -2
  12. Mixtral-8x7B-v0.1-Q8_0.gguf +2 -2
  13. README.md +6 -3
Mixtral-8x7B-v0.1-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d6708dacdf40294fbc63a306b5ccb4f9dc73e52758bee9daae3427ce3db4510d
3
- size 17311229376
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ede26471cd9d1b41667edbd604f78948c58b5d923f19383236f9334deebd42e
3
+ size 17311229408
Mixtral-8x7B-v0.1-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:429f2ce90dd04e3812ceaeeda0172442217590eee05448c4ccc4a33f53f8d934
3
- size 24169645504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d7968dca294b2239f9e8b29f1d296078d470444c8afcbd6b2549cd8ad732416
3
+ size 24169645536
Mixtral-8x7B-v0.1-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:29926547420f6000b43053acc4be43f20987cf637a66a9515ae16372c83994eb
3
- size 22546449856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f41f7fe40abf353d113a62bb8f160804333542bbf0bb9ffca10275696aa3a184
3
+ size 22546449888
Mixtral-8x7B-v0.1-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:45aa947ea9984e005b2f205bfa87271f424ebfb1a57333fe2ee87c1b3c093e28
3
- size 20432520640
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd2bd4087031eb84f21b9dae399819f7fc0904f83ed65a29fbb589fb2aa80480
3
+ size 20432520672
Mixtral-8x7B-v0.1-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:af107c0a297c129e85a24b7aee74313d16f6cb952ab77460c9238a5cd30b0e70
3
- size 26443589056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c00a4451eb77369fbfaed9aa730362d67bd0bffdce730a452abbb962f7c5b06
3
+ size 26443589088
Mixtral-8x7B-v0.1-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:98bc77393854258fc85ccf4e76b370b4c5400b677fa7f833e8cb8947cf37551e
3
- size 28448466368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:974d8d5f4c5fc961b450f908e8d25290c8a0ee1d02d47d8df48555c1b5a0c115
3
+ size 28448466400
Mixtral-8x7B-v0.1-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2bcdec65acb14c5fb16f689a33c55e1f54b868c8b4b7fdb6aa049e94ba468e98
3
- size 26745578944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97c64d04e20bd5f1ed16b8b4d00f15c2c5d99f2634c41855c6cd56247d8e0d20
3
+ size 26745578976
Mixtral-8x7B-v0.1-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5d5d4ff05f757d2d5f64b94771e5e5c8e0447af5d2ab0f0a4b607d7c07ba7ce1
3
- size 32231335360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d94e8e6e47be2212b3409d6b7908c8c83c5e4582c236b17404d5886ab8c5dac3
3
+ size 32231335392
Mixtral-8x7B-v0.1-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:764511ada16ce92e9827668cbf0619966089bb935ccb142ccb1a4ebaa40c223a
3
- size 33229579712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1febe1979e6537536f5075309d11e37fa2153ac8a4ac621203f314b818cede22
3
+ size 33229579744
Mixtral-8x7B-v0.1-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75f532e0d7f0830a02b8441d668b852d28b37bac9ae3f05d6ab30c9f88787d9c
3
- size 32231335360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c497a772e9ac98ce11ce91eb3c78156a9442f5a8db7bd993c02c1aa2b44d61f
3
+ size 32231335392
Mixtral-8x7B-v0.1-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:be6da02b20dc9b2515d5481823dd6f969c81f3244aa0ec8cd1251b93470569ed
3
- size 38380815808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1050e9c1eea54e4c56f1b4881ae4d970655cd75764e339ef78461979dfec3de
3
+ size 38380815840
Mixtral-8x7B-v0.1-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:80681417b867e84cd7843734e54bc3534b7dec2f1a251e415575fcfe76be75b0
3
- size 49626318272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fda704f6c772760e53b7a2d3cd287aa5ee8a58a2fcbbb2dd4457afad670188a
3
+ size 49626318304
README.md CHANGED
@@ -7,9 +7,12 @@ language:
7
  - es
8
  - en
9
  tags:
 
10
  - TensorBlock
11
  - GGUF
12
- base_model: model-hub/Mixtral-8x7B-v0.1
 
 
13
  ---
14
 
15
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -23,9 +26,9 @@ base_model: model-hub/Mixtral-8x7B-v0.1
23
  </div>
24
  </div>
25
 
26
- ## model-hub/Mixtral-8x7B-v0.1 - GGUF
27
 
28
- This repo contains GGUF format model files for [model-hub/Mixtral-8x7B-v0.1](https://huggingface.co/model-hub/Mixtral-8x7B-v0.1).
29
 
30
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
31
 
 
7
  - es
8
  - en
9
  tags:
10
+ - moe
11
  - TensorBlock
12
  - GGUF
13
+ extra_gated_description: If you want to learn more about how we process your personal
14
+ data, please read our <a href="https://mistral.ai/fr/terms/">Privacy Policy</a>.
15
+ base_model: mistralai/Mixtral-8x7B-v0.1
16
  ---
17
 
18
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
26
  </div>
27
  </div>
28
 
29
+ ## mistralai/Mixtral-8x7B-v0.1 - GGUF
30
 
31
+ This repo contains GGUF format model files for [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1).
32
 
33
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
34