list index out of range
#2
by
hussainwali1
- opened
Hey @TheBloke thank you for the model, can you please tell me how can i fix this, I am getting this on other models as well.
File "C:\oobabooga_windows\text-generation-webui\modules\chat.py", line 128, in get_stopping_strings
state['turn_template'].split('<|user-message|>')[1].split('<|bot|>')[0] + '<|bot|>',
IndexError: list index out of range
Also can you please tell me how to make the model stop? where do i add this <|bot|>
and can you give me a pointer how can I deploy these models to production, rest API, multi session etc. Thank you in advance :)
Another user found a solution to that, please see here: https://huggingface.co./TheBloke/OpenAssistant-SFT-7-Llama-30B-GPTQ/discussions/12#646650c33b99ed9970fc64cc