Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
QuantFactory
/
Meta-Llama-3-70B-Instruct-GGUF
like
45
Follow
Quant Factory
298
Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
Inference Endpoints
conversational
License:
llama3
Model card
Files
Files and versions
Community
4
Deploy
Use this model
main
Meta-Llama-3-70B-Instruct-GGUF
2 contributors
History:
22 commits
munish0838
Update README.md
f52a895
verified
8 months ago
.gitattributes
Safe
2.93 kB
Upload Meta-Llama-3-70B-Instruct.Q4_0.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q2_K.gguf
Safe
26.4 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q2_K.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q3_K_L.gguf
Safe
37.1 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q3_K_L.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q3_K_M.gguf
Safe
34.3 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q3_K_M.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q3_K_S.gguf
Safe
30.9 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q3_K_S.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q4_0.gguf
Safe
40 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q4_0.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q4_1.gguf
Safe
44.3 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q4_1.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q4_K_M.gguf
Safe
42.5 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q4_K_M.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q4_K_S.gguf
Safe
40.3 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q4_K_S.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q5_0.gguf
Safe
48.7 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q5_0.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q5_1-00001-of-00002.gguf
Safe
34.3 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q5_1-00001-of-00002.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q5_1-00002-of-00002.gguf
Safe
18.7 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q5_1-00002-of-00002.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q5_K_M.gguf
Safe
50 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q5_K_M.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q5_K_S.gguf
Safe
48.7 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q5_K_S.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q6_K-00001-of-00002.gguf
Safe
32.1 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q6_K-00001-of-00002.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q6_K-00002-of-00002.gguf
Safe
25.7 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q6_K-00002-of-00002.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q8_0-00001-of-00003.gguf
Safe
32 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q8_0-00001-of-00003.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q8_0-00002-of-00003.gguf
Safe
32.1 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q8_0-00002-of-00003.gguf with huggingface_hub
8 months ago
Meta-Llama-3-70B-Instruct.Q8_0-00003-of-00003.gguf
Safe
10.9 GB
LFS
Upload Meta-Llama-3-70B-Instruct.Q8_0-00003-of-00003.gguf with huggingface_hub
8 months ago
README.md
Safe
38.1 kB
Update README.md
8 months ago
