Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
4-bit precision
AutoTrain Compatible
text-generation-inference
Inference Endpoints
custom_code
Merge
8-bit precision
Eval Results
Mixture of Experts
text-embeddings-inference
Carbon Emissions
Apply filters
Models
14,752
Full-text search
Edit filters
Sort: Trending
Active filters:
4-bit
Clear all
Qwen/Qwen2.5-32B-Instruct-AWQ
Text Generation
•
Updated
4 days ago
•
548
•
13
Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4
Text Generation
•
Updated
4 days ago
•
807
•
10
Qwen/Qwen2-VL-72B-Instruct-AWQ
Image-Text-to-Text
•
Updated
1 day ago
•
778
•
9
Qwen/Qwen2.5-72B-Instruct-AWQ
Text Generation
•
Updated
4 days ago
•
695
•
9
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation
•
Updated
20 days ago
•
298k
•
66
MaziyarPanahi/solar-pro-preview-instruct-GGUF
Text Generation
•
Updated
9 days ago
•
7.71k
•
13
flowaicom/Flow-Judge-v0.1-AWQ
Text Generation
•
Updated
5 days ago
•
345
•
5
Qwen/Qwen2.5-14B-Instruct-AWQ
Text Generation
•
Updated
4 days ago
•
4.83k
•
5
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16
Text Generation
•
Updated
Aug 13
•
101k
•
19
openbmb/MiniCPM-V-2_6-int4
Visual Question Answering
•
Updated
Aug 8
•
13.1k
•
55
pzc163/MiniCPMv2_6-prompt-generator
Updated
30 days ago
•
1.6k
•
30
Qwen/Qwen2-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
Updated
1 day ago
•
9.42k
•
21
ModelCloud/GRIN-MoE-gptq-4bit
Updated
3 days ago
•
6
•
4
CohereForAI/c4ai-command-r-plus-4bit
Text Generation
•
Updated
Aug 13
•
661
•
239
openbmb/MiniCPM-Llama3-V-2_5-int4
Visual Question Answering
•
Updated
Jul 22
•
22.7k
•
70
DataPilot/gemma2-Intelligent-Investor-5b-v2.5
Text2Text Generation
•
Updated
6 days ago
•
17
•
3
Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4
Text Generation
•
Updated
4 days ago
•
263
•
3
LoneStriker/Mistral-Small-Instruct-2409-4.0bpw-h6-exl2
Updated
5 days ago
•
46
•
3
MaziyarPanahi/BioMistral-7B-GGUF
Text Generation
•
Updated
Feb 19
•
913
•
43
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
•
Updated
Aug 7
•
322k
•
53
speakleash/Bielik-11B-v2.2-Instruct-GPTQ
Text Generation
•
Updated
25 days ago
•
593
•
3
speakleash/Bielik-11B-v2.2-Instruct-AWQ
Text Generation
•
Updated
25 days ago
•
132
•
3
Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
Updated
1 day ago
•
608
•
2
Qwen/Qwen2.5-7B-Instruct-AWQ
Text Generation
•
Updated
4 days ago
•
559
•
2
MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF
Text Generation
•
Updated
5 days ago
•
150
•
2
unsloth/Qwen2.5-7B-Instruct-bnb-4bit
Text Generation
•
Updated
4 days ago
•
230
•
2
unsloth/Qwen2.5-3B-Instruct-bnb-4bit
Text Generation
•
Updated
4 days ago
•
63
•
2
unsloth/Qwen2.5-32B-Instruct-bnb-4bit
Text Generation
•
Updated
4 days ago
•
157
•
2
ParasiticRogue/Magnum-Instruct-DPO-12B-exl2-4.0
Text Generation
•
Updated
10 days ago
•
11
•
2
TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
Text Generation
•
Updated
Sep 27, 2023
•
7.94k
•
313
Previous
1
2
3
...
492
Next