Edit Models filters

Model Tree

Qwen/Qwen2.5-7B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

122

Full-text search

Active filters: Qwen/Qwen2.5-7B-Instruct

Triangle104/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 19 • 1

tobchef/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 19 • 1

Triangle104/Qwen2.5-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Sep 19 • 1

Triangle104/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 19 • 5

Triangle104/Qwen2.5-7B-Instruct-Q6_K-GGUF

Text Generation • Updated Sep 19 • 2

Triangle104/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 19 • 6

DrNicefellow/Qwen2.5-7B-Instruct-4.0bpw-exl2

Updated Sep 20 • 4

DrNicefellow/Qwen2.5-7B-Instruct-8.0bpw-h8-exl2

Updated Sep 20 • 4 • 1

DrNicefellow/Qwen2.5-7B-Instruct-7.0bpw-exl2

Updated Sep 20 • 7

DrNicefellow/Qwen2.5-7B-Instruct-6.0bpw-exl2

Updated Sep 20 • 3

DrNicefellow/Qwen2.5-7B-Instruct-5.0bpw-exl2

Updated Sep 20 • 7

DrNicefellow/Qwen2.5-7B-Instruct-2.0bpw-exl2

Updated Sep 20 • 5

DrNicefellow/Qwen2.5-7B-Instruct-1.0bpw-exl2

Updated Sep 20 • 4

DrNicefellow/Qwen2.5-7B-Instruct-5.5bpw-exl2

Updated Sep 20 • 5

DrNicefellow/Qwen2.5-7B-Instruct-4.5bpw-exl2

Updated Sep 20 • 14

raaedk/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 21 • 4

WSDW/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 21 • 7 • 1

mukel/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 27 • 15

idasummer/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 24 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft

Updated Nov 18 • 7

QuantFactory/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Sep 25 • 181 • 1

mradermacher/Qwen2.5-7B-Instruct-GGUF

Updated Oct 11 • 402 • 2

mradermacher/Qwen2.5-7B-Instruct-i1-GGUF

Updated Oct 11 • 104 • 1

aswqazx/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 27 • 4

Kondara/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 27

Kondara/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 28 • 4

VPTQ-community/Qwen2.5-7B-Instruct-v16-k65536-65536-woft

Updated Nov 18 • 20 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-65536-woft

Updated Nov 18 • 8

VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft

Updated Nov 18 • 7

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-0-woft

Updated Nov 18 • 44