mistralai/Mistral-Nemo-Base-2407 · Mistral Nemo Value Error while using model

Hi there,

The model loads correctly. But when I try to use it for inference, I get the following error:

  File "/miniconda3/envs/table-talk/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/miniconda3/envs/table-talk/lib/python3.10/site-packages/transformers/generation/utils.py", line 1689, in generate
    self._validate_model_kwargs(model_kwargs.copy())
  File "/miniconda3/envs/table-talk/lib/python3.10/site-packages/transformers/generation/utils.py", line 1243, in _validate_model_kwargs
    raise ValueError(
ValueError: The following `model_kwargs` are not used by the model: ['token_type_ids'] (note: typos in the generate arguments will also show up in this list)

I am currently using the following versions:

Name: transformers
Version: 4.45.0.dev0

Name: torch
Version: 2.3.1

Can anyone help me fix this?

Best,
Zoher