Granite-3.1 Quantized - a neuralmagic-ent Collection

neuralmagic-ent 's Collections

DeepSeek-R1-Distill Quantized

DeepSeek-Coder-V2-Instruct-0724 Quantized

DeepSeek-V2.5-1210 Quantized

Granite-3.1 Quantized

Mixtral 8x22B v0.1 Quantized

Mixtral 8x7B v0.1 Quantized

Llama 3.1 Nemotron Quantized

DeepSeekCoder-V2 Quantized

Qwen2.5 Math Quantized

Qwen2.5 Coder Quantized

Phi-3 Quantized

Llama 3.3 Quantized

Llama 3.2 Quantized

Llama 3.1 Quantized

Granite-3.1 Quantized

updated 21 days ago

neuralmagic/granite-3.1-2b-instruct-quantized.w8a8

Text Generation • Updated 13 days ago • 208
neuralmagic/granite-3.1-8b-instruct-FP8-dynamic

Text Generation • Updated 13 days ago • 107 • 1
neuralmagic/granite-3.1-2b-instruct-quantized.w4a16

Text Generation • Updated 13 days ago • 239
neuralmagic/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • Updated 7 days ago • 171 • 1
neuralmagic/granite-3.1-8b-instruct-quantized.w8a8

Text Generation • Updated 13 days ago • 182
neuralmagic/granite-3.1-2b-instruct-FP8-dynamic

Text Generation • Updated 9 days ago • 79
neuralmagic/granite-3.1-2b-base-quantized.w4a16

Text Generation • Updated 7 days ago • 37
neuralmagic/granite-3.1-2b-base-quantized.w8a8

Text Generation • Updated 7 days ago • 29
neuralmagic/granite-3.1-8b-base-FP8-dynamic

Updated 7 days ago
neuralmagic/granite-3.1-2b-base-FP8-dynamic

Text Generation • Updated 7 days ago • 41
neuralmagic/granite-3.1-8b-base-quantized.w4a16

Text Generation • Updated 7 days ago • 33
neuralmagic/granite-3.1-8b-base-quantized.w8a8

Text Generation • Updated 7 days ago • 12