Qwen1.5 Chat 4B for RK3588

This is a conversion from https://huggingface.co./Qwen/Qwen1.5-4B-Chat to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588

Main repo

See this for my full collection of converted LLMs for the RK3588's NPU:

https://huggingface.co./Pelochus/ezrkllm-collection

License

Same as the original LLM https://huggingface.co./Qwen/Qwen1.5-4B-Chat

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .