How do I use this model along with HuggingfaceInference ?

#31
by perceptron-743 - opened

Hey @all . I want to use this model but I don't have the utilities to load it locally. For that reason I am going to use HuggingfaceInference. So is this model available for inference? Because when I paste the inference url here: (inference_url)[https://api-inference.huggingface.co/models/microsoft/Phi-3.5-vision-instruct] . The url works fine and returns a proper response.

But now the question is what input should I post at this url. How do I post both text AND image to this endpoint? Does anyone know how to figure this out?

Sign up or log in to comment