Text Generation
Transformers
Safetensors
English
llama
nvidia
llama3.1
conversational
text-generation-inference

Getting context deadline exceeded in Ollama Windows

#43
by DesertCookie - opened

Using the command copied from the Use this model section: ollama run hf.co/bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF:IQ1_M. After about 10 seconds I get Error: context deadline exceeded.

Using Ollama 0.5.1 on Windows 11.

Using the command copied from the Use this model section: ollama run hf.co/bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF:IQ1_M. After about 10 seconds I get Error: context deadline exceeded.

Using Ollama 0.5.1 on Windows 11.

I kept on repeating the same command and eventually after 2,3 attempts, it got downloaded successfully.

Sign up or log in to comment