70B-Chinese in the future？
#27
by
woshimark666
- opened
70B version in the future?
This comment has been hidden
Yes, 70B is on the way!
It seems that it is indeed limited by the size limit of the 8B parameter. When performing role-playing under complex rules, the model output will become very poor. However, the 70B parameter model is much better, but there will still be instances of using adjectives that have appeared in previous contexts when role-playing in Chinese.
The 70B version has been released! Have a try!
https://huggingface.co./shenzhi-wang/Llama3-70B-Chinese-Chat
Will there be an unlimited version, similar to dolphin-2.9-llama3-70b, that has been further fine-tuned for improved Chinese performance?