Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
chatpdflocal
/
llama3.1-8b-gguf
like
26
Follow
chatpdflocal
1
Transformers
GGUF
English
llama3.1
macos
chatpdf
local
text-generation-inference
meta
facebook
llama
llama.cpp
legal
llama3.1-8b
quantization
Inference Endpoints
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
main
llama3.1-8b-gguf
2 contributors
History:
22 commits
Vincent-Lee
Update README.md
d8b06db
verified
6 days ago
.gitattributes
Safe
1.81 kB
Upload ggml-model-f16.gguf
4 months ago
README.md
Safe
1.4 kB
Update README.md
6 days ago
ggml-model-Q2_K.gguf
Safe
3.18 GB
LFS
Upload ggml-model-Q2_K.gguf
4 months ago
ggml-model-Q3_K_M.gguf
Safe
4.02 GB
LFS
Upload ggml-model-Q3_K_M.gguf
4 months ago
ggml-model-Q4_K_M.gguf
Safe
4.92 GB
LFS
Upload ggml-model-Q4_K_M.gguf
4 months ago
ggml-model-Q8_0.gguf
Safe
8.54 GB
LFS
Upload ggml-model-Q8_0.gguf
4 months ago
ggml-model-f16.gguf
Safe
16.1 GB
LFS
Upload ggml-model-f16.gguf
4 months ago
