503 Server Error: Service Unavailable for model 'google/flan-t5-large'
#28
by
anjalisibu28
- opened
Hello Hugging Face community,
I am experiencing a 503 Server Error: Service Unavailable
when trying to interact with the model google/flan-t5-large
using the Hugging Face Inference API.
Steps to Reproduce:
I am using the following model in my code:
url = "https://api-inference.huggingface.co/models/google/flan-t5-large"
I send a POST request to the API with a payload:
{ "inputs": "my prompt here" }
The response I receive is:
HTTP error occurred: 503 Server Error: Service Unavailable for url: https://api-inference.huggingface.co/models/google/flan-t5-large
Expected Behavior:
The model should return predictions.
Actual Behavior:
I am receiving a 503 Server Error: Service Unavailable
, indicating that the service is temporarily down or unavailable.
Environment:
- API endpoint:
https://api-inference.huggingface.co/models/google/flan-t5-large
- Token used: 'xxxxx'
- Model:
google/flan-t5-large
- Programming language: Python
- Library used:
requests
Additional Notes:
- I have verified the token and the API endpoint, and both appear to be correct.
- I have tested with other models, but this issue seems specific to
google/flan-t5-large
. - I am able to reproduce the issue consistently.
Could anyone assist with resolving this issue or provide guidance on what might be causing this error?
Tags: #huggingface #api #flan-t5-large #503error