Post
3007
Finally, Qwen1.5-110B is out! With weights and demo!
Blog: https://qwenlm.github.io/blog/qwen1.5-110b/
Demo: Qwen/Qwen1.5-110B-Chat-demo
Base: Qwen/Qwen1.5-110B
Chat: Qwen/Qwen1.5-110B-Chat
This model has some specific features:
* GQA
* 32K token context length
* Multilingual support
We feel good about its performance on benchmarks, including those for base models and chat models, but we still need more of your testing and feedback to help us know its capabilities and limitations!
Additionally, the base model has not learned chatml tokens. Yeah if you use chatml format, you need to be careful about it!
Enjoy and stay tuned for Qwen2!
Blog: https://qwenlm.github.io/blog/qwen1.5-110b/
Demo: Qwen/Qwen1.5-110B-Chat-demo
Base: Qwen/Qwen1.5-110B
Chat: Qwen/Qwen1.5-110B-Chat
This model has some specific features:
* GQA
* 32K token context length
* Multilingual support
We feel good about its performance on benchmarks, including those for base models and chat models, but we still need more of your testing and feedback to help us know its capabilities and limitations!
Additionally, the base model has not learned chatml tokens. Yeah if you use chatml format, you need to be careful about it!
Enjoy and stay tuned for Qwen2!