runtime error
Exit code: 1. Reason: INFO 02-23 13:36:46 __init__.py:211] No platform detected, vLLM is running on UnspecifiedPlatform Traceback (most recent call last): File "/home/user/app/app.py", line 19, in <module> from utils import ( File "/home/user/app/utils.py", line 13, in <module> BASE_MODEL = LLM(model="Qwen/Qwen2.5-Coder-7B-Instruct", enable_lora=True) File "/usr/local/lib/python3.10/site-packages/vllm/utils.py", line 1022, in inner return fn(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/vllm/entrypoints/llm.py", line 242, in __init__ self.llm_engine = self.engine_class.from_engine_args( File "/usr/local/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 486, in from_engine_args engine_config = engine_args.create_engine_config(usage_context) File "/usr/local/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 1126, in create_engine_config device_config = DeviceConfig(device=self.device) File "/usr/local/lib/python3.10/site-packages/vllm/config.py", line 1660, in __init__ raise RuntimeError("Failed to infer device type") RuntimeError: Failed to infer device type
Container logs:
Fetching error logs...