How do I use this model along with HuggingfaceInference ?
#31
by
perceptron-743
- opened
Hey @all . I want to use this model but I don't have the utilities to load it locally. For that reason I am going to use HuggingfaceInference. So is this model available for inference? Because when I paste the inference url here: (inference_url)[https://api-inference.huggingface.co/models/microsoft/Phi-3.5-vision-instruct] . The url works fine and returns a proper response.
But now the question is what input should I post at this url. How do I post both text AND image to this endpoint? Does anyone know how to figure this out?