Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
leafspark
/
DeepSeek-V2-Chat-GGUF
like
24
Text Generation
Transformers
GGUF
English
Chinese
code
deepseek
bf16
Inference Endpoints
imatrix
conversational
License:
mit
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
main
DeepSeek-V2-Chat-GGUF
1 contributor
History:
136 commits
leafspark
readme: update info
e33a1af
verified
5 months ago
DeepSeek-V2-Chat.bf16.gguf
Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-22-of-22.gguf with huggingface_hub
6 months ago
DeepSeek-V2-Chat.iq2_xxs.gguf
Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub
6 months ago
DeepSeek-V2-Chat.iq3_xs.gguf
Upload DeepSeek-V2-Chat.iq3_xs.gguf/DeepSeek-V2-Chat.IQ3_XS-00008-of-00008.gguf with huggingface_hub
6 months ago
DeepSeek-V2-Chat.q2_k.gguf
tool: add kv overrides to start command (win)
6 months ago
DeepSeek-V2-Chat.q3_k_m.gguf
Upload DeepSeek-V2-Chat.q3_k_m.gguf/DeepSeek-V2-Chat.Q3_K_M-00006-of-00006.gguf with huggingface_hub
6 months ago
DeepSeek-V2-Chat.q4_k_m.gguf
Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00006-of-00008.gguf with huggingface_hub
6 months ago
DeepSeek-V2-Chat.q5_k_m.gguf
Upload DeepSeek-V2-Chat.q5_k_m.gguf/DeepSeek-V2-Chat.Q5_K_M-00008-of-00008.gguf with huggingface_hub
5 months ago
DeepSeek-V2-Chat.q6_k.gguf
Upload DeepSeek-V2-Chat.q6_k.gguf/DeepSeek-V2-Chat.Q6_K-00010-of-00010.gguf with huggingface_hub
5 months ago
DeepSeek-V2-Chat.q8_0.gguf
Upload DeepSeek-V2-Chat.q8_0.gguf/DeepSeek-V2-Chat.Q8_0-00012-of-00012.gguf with huggingface_hub
6 months ago
.gitattributes
Safe
10.4 kB
Upload DeepSeek-V2-Chat.q6_k.gguf/DeepSeek-V2-Chat.Q6_K-00010-of-00010.gguf with huggingface_hub
5 months ago
LICENSE
Safe
13.8 kB
license: add DeepSeek license
6 months ago
README.md
Safe
5.1 kB
readme: update info
5 months ago
imatrix.dat
Safe
456 MB
LFS
imatrix: add chunk 63 (final)
6 months ago