amd/Qwen1.5-7B-Chat-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation
•
Updated
•
14
Quark Quantized ONNX LLMs for Ryzen AI 1.3 EA
ONNX Runtime generate() API based models quantized by Quark and optimized for Ryzen AI Strix Point NPU
-
-
amd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Updated • 14 -
amd/Llama-2-7b-hf-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 21 -
amd/Meta-Llama-3-8B-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 12 -
amd/Llama2-7b-chat-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 14 -
amd/Llama-3.1-8B-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 38 • 1 -
amd/Phi-3.5-mini-instruct-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 97 • 1 -
amd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp32-onnx-ryzen-strix
Text Generation • Updated • 20 • 1