ValueError: If no `decoder_input_ids` or `decoder_inputs_embeds` are passed, `input_ids` cannot be `None`
I am trying to get the decoder hidden state of the florence 2 model. I was following this https://huggingface.co./microsoft/Florence-2-large/blob/main/modeling_florence2.py to understand the parameters that goes into the forward method. I tried something like
Pass inputs to the model with output_hidden_states=True to get hidden states
with torch.no_grad():
outputs = model(
input_ids=inputs["input_ids"],
pixel_values=inputs["pixel_values"],
attention_mask=inputs["attention_mask"],
output_hidden_states=True, # Request hidden states
)
But doing this I'm getting this error:
ValueError: If no decoder_input_ids or decoder_inputs_embeds are passed, input_ids cannot be None. Please pass either input_ids or decoder_input_ids or decoder_inputs_embeds.
Also I am using this model for inference only, what does the decoder_input_ids mean and where I can find this to pass in the forward method.
I have the exact same issue. If you have found the solution to it then please let me know!