wenhua cheng's picture

9 5 14

wenhua cheng

wenhuach

·

wenhuach21

AI & ML interests

Model Compression, CV

Recent Activity

reacted to their post with 🚀 2 days ago

Are we the only providers of INT4 quantized models for Llama 3.2 VL? https://huggingface.co./OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc https://huggingface.co./OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc

posted an update 2 days ago

Are we the only providers of INT4 quantized models for Llama 3.2 VL? https://huggingface.co./OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc https://huggingface.co./OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc

replied to their post 7 days ago

AutoRound has demonstrated strong results even at 2-bit precision for VLM models like QWEN2-VL-72B. Check it out here: https://huggingface.co./OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc.

View all activity

Organizations

Posts 6

Post

2097

Are we the only providers of INT4 quantized models for Llama 3.2 VL?
OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc
OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc

Post

1772

AutoRound has demonstrated strong results even at 2-bit precision for VLM models like QWEN2-VL-72B. Check it out here: OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc.

Papers 2

arxiv:2310.10944

arxiv:2309.05516

models

None public yet

datasets

None public yet