fastapi
uvicorn[standard]
torch
transformers
accelerate
huggingface_hub
accelerate>=0.26.0