503 Server Error: Service Unavailable for model 'google/flan-t5-large'

#28
by anjalisibu28 - opened

Hello Hugging Face community,

I am experiencing a 503 Server Error: Service Unavailable when trying to interact with the model google/flan-t5-large using the Hugging Face Inference API.

Steps to Reproduce:

  1. I am using the following model in my code:

    url = "https://api-inference.huggingface.co/models/google/flan-t5-large"
    
  2. I send a POST request to the API with a payload:

    {
        "inputs": "my prompt here"
    }
    
  3. The response I receive is:

    HTTP error occurred: 503 Server Error: Service Unavailable for url: https://api-inference.huggingface.co/models/google/flan-t5-large
    

Expected Behavior:

The model should return predictions.

Actual Behavior:

I am receiving a 503 Server Error: Service Unavailable, indicating that the service is temporarily down or unavailable.

Environment:

  • API endpoint: https://api-inference.huggingface.co/models/google/flan-t5-large
  • Token used: 'xxxxx'
  • Model: google/flan-t5-large
  • Programming language: Python
  • Library used: requests

Additional Notes:

  • I have verified the token and the API endpoint, and both appear to be correct.
  • I have tested with other models, but this issue seems specific to google/flan-t5-large.
  • I am able to reproduce the issue consistently.

Could anyone assist with resolving this issue or provide guidance on what might be causing this error?
Tags: #huggingface #api #flan-t5-large #503error

Sign up or log in to comment