Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
gguf-my-repo
Inference Endpoints
Merge
Eval Results
text-generation-inference
AutoTrain Compatible
Mixture of Experts
Carbon Emissions
custom_code
text-embeddings-inference
Misc with no match
4-bit precision
8-bit precision
Apply filters
Models
11,228
Full-text search
Edit filters
Sort: Trending
Active filters:
gguf-my-repo
Clear all
NikolayKozloff/h2o-danube3-4b-base-Q8_0-GGUF
Text Generation
•
Updated
Jul 15, 2024
•
2
xiaoshuai111/lawyer-llama-13b-v2-Q4_0-GGUF
Updated
Aug 28, 2024
•
153
•
3
NikolayKozloff/h2o-danube3-500m-base-Q8_0-GGUF
Text Generation
•
Updated
Jul 15, 2024
•
2
PatronusAI/Llama-3-Patronus-Lynx-70B-Instruct-Q4_K_M-GGUF
Updated
Jul 17, 2024
•
5
clarkguilty/cosmosage-v3-Q8_0-GGUF
Text Generation
•
Updated
Jul 15, 2024
•
2
clarkguilty/cosmosage-v3-Q6_K-GGUF
Text Generation
•
Updated
Jul 15, 2024
VAIBHAV22334455/NOVA-3B.v2-Q8_0-GGUF
Updated
Jul 15, 2024
•
1
Lancer1408/LLaMa-3-Stheno-v3.2-15B-Q5_K_M-GGUF
Updated
Jul 15, 2024
•
1
plehrman24/Meta-Llama-3-8B-Instruct-Q8_0-GGUF
Text Generation
•
Updated
Jul 15, 2024
vincentl2189/RolePlayLake-7B-Toxic-Q5_K_M-GGUF
Updated
Jul 15, 2024
•
1
plehrman24/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF
Text Generation
•
Updated
Jul 15, 2024
•
1
Ransss/L3-15B-MythicalMaid-t0.0001-Q8_0-GGUF
Updated
Jul 15, 2024
Ransss/L3-15B-MythicalMaid-t0.0001-Q6_K-GGUF
Updated
Jul 15, 2024
•
3
Ransss/L3-8B-Tamamo-v1-Q8_0-GGUF
Updated
Jul 15, 2024
•
2
•
1
reach-vb/NuminaMath-7B-TIR-Q8_0-GGUF
Text Generation
•
Updated
Jul 15, 2024
•
3
•
23
bazsalazas/Mistral-7B-v0.3-Q4_K_M-GGUF
Updated
Jul 15, 2024
•
3
Alex01837178373/gemma-2-9b-it-abliterated-IQ4_NL-GGUF
Updated
Jul 15, 2024
•
5
Alex01837178373/gemma-2-9b-it-abliterated-IQ3_M-GGUF
Updated
Jul 15, 2024
Alex01837178373/gemma-2-9b-it-abliterated-Q4_K_M-GGUF
Updated
Jul 15, 2024
•
3
Aldaris/DeepSeek-V2-Lite-Chat-Q4_K_M-GGUF
Updated
Jul 16, 2024
•
3
Aldaris/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF
Updated
Jul 16, 2024
qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF
Text Generation
•
Updated
Jul 16, 2024
KnutJaegersberg/gemma-2-9b-it-abliterated-Q8_0-GGUF
Updated
Jul 16, 2024
•
5
Bhargav3514/Fox-1-1.6B-Instruct-v0.1-Q4_K_M-GGUF
Updated
Jul 16, 2024
amitj1jan/Meta-Llama-3-8B-Instruct-Q2_K-GGUF
Text Generation
•
Updated
Jul 16, 2024
Cran-May/Chinese-LLaMA-2-13B-hf-Q4_K_M-GGUF
Updated
Jul 16, 2024
•
1
martintomov/NuminaMath-7B-TIR-Q4_K_M-GGUF
Text Generation
•
Updated
Jul 16, 2024
•
1
martintomov/NuminaMath-7B-TIR-Q8_0-GGUF
Text Generation
•
Updated
Jul 16, 2024
xxyzz/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF
Text Generation
•
Updated
Jul 20, 2024
•
1
guihudge2/Mistral-7B-v0.3-Q4_K_M-GGUF
Updated
Jul 16, 2024
Previous
1
...
98
99
100
Next