Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
phi-4-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
phi-4-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
acb92eeb0585e4da28a3c5a42ae9f00af21b89edee7208ec76a94fc364ef6062
003bc25
verified
4 days ago
.gitattributes
Safe
2.11 kB
fd416c460b26b6fae03d5036ff12110e5f3ff4cf45d763156ddb8e7a62e3fc79
4 days ago
README.md
Safe
2.82 kB
acb92eeb0585e4da28a3c5a42ae9f00af21b89edee7208ec76a94fc364ef6062
4 days ago
phi-4.Q2_K.gguf
Safe
5.55 GB
LFS
9ced8e4bc850e44c7c1d25e93169bca1d89975dfd0083b2eca2fb2660c777910
4 days ago
phi-4.Q3_K_L.gguf
Safe
7.93 GB
LFS
966a0e331e1516e5d704ee0959ae47caf310c44b929b00cb67206a6d61e42415
4 days ago
phi-4.Q3_K_M.gguf
Safe
7.36 GB
LFS
06d8833a08fb3087e0f5738c2617a2501846b3b9e4b32f0a9df4fe32e3b45c5b
4 days ago
phi-4.Q3_K_S.gguf
Safe
6.5 GB
LFS
212d982fc4f3a1bcf6557e91427638f23d19426854d25c63645f0725d6aa6602
4 days ago
phi-4.Q4_K_M.gguf
Safe
9.05 GB
LFS
281faa52feaf12da05a335d477d90fe80131ca0c997c023ed7d2e5f0135d6b4c
4 days ago
phi-4.Q4_K_S.gguf
Safe
8.44 GB
LFS
031d43e36ce546219db605576588bb4f3e889a4b9d843b4bb37732cd64649ca0
4 days ago
phi-4.Q5_K_M.gguf
Safe
10.6 GB
LFS
db6112a867f09ca9bf9d4b611cb4028bc6eb1b129f21822669e67a2a0e6b70bc
4 days ago
phi-4.Q5_K_S.gguf
Safe
10.2 GB
LFS
d206186dc8c1e58af9eb0c07846e03d5d9d7fc434b0652a834e380e82724d512
4 days ago
phi-4.Q6_K.gguf
Safe
12 GB
LFS
8fa476d4027b986bcc2b859d697d2e726815307ef65f52e64e3598b949abf34d
4 days ago
phi-4.Q8_0.gguf
Safe
15.6 GB
LFS
57b6c7ab1039309fc838aa54cc8e7d5d6fe1e4cea3dfda9a0717d4217c88e8e2
4 days ago
phi-4.fp16.gguf
Safe
29.3 GB
LFS
fd416c460b26b6fae03d5036ff12110e5f3ff4cf45d763156ddb8e7a62e3fc79
4 days ago