Qwen Separation, understanding modeling
#5
by
SinanAkkoyun
- opened
Thank you for your awesome work, truly revolutionary
I'd like to separate the Qwen part but found it difficult to see similarities between modeling_qwen and modeling_molmo
Would you be so kind to guide me oj separating the Clip, MLP and Qwen weights? Thanks :)
https://huggingface.co./allenai/Molmo-7B-D-0924/discussions/10
Sorry, wrong model haha
SinanAkkoyun
changed discussion status to
closed