codefuse-ai

/

CodeFuse-DeepSeek-33B

like 58

The output with text generation web UI are all ':::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::', what I need to do?

I haven't tested with text-generation-webui yet. I'm not sure if text-generation-webui supports custom inference formats, as our model requires a specific inference format as follows:

<s>human
User prompt...
<s>bot

Here is an example:

<s>human
# language: Python
from typing import List
def separate_paren_groups(paren_string: str) -> List[str]:
    """ Input to this function is a string containing multiple groups of nested parentheses. Your goal is to
    separate those group into separate strings and return the list of those.
    Separate groups are balanced (each open brace is properly closed) and not nested within each other
    Ignore any spaces in the input string.
    >>> separate_paren_groups('( ) (( )) (( )( ))')
    ['()', '(())', '(()())']
    """
<s>bot

I think you'll need to tweak the code in text-generation-webui that handles the inference format.