Spaces:
Running
on
CPU Upgrade
Two model evaluations failed for abacusai/Dracarys-*
Hi,
following up on two model eval failures that occured:
https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/abacusai/Dracarys-72B-Instruct_eval_request_False_bfloat16_Original.json
https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/abacusai/Dracarys-Llama-3.1-70B-Instruct_eval_request_False_bfloat16_Original.json
We have run a subset of the leaderboard evals with no issue. Could you please see if this was a transient infra failure during eval?
Thank you.
- Siddartha
Hi @siddartha-abacus ,
I've resubmitted your models. It seems like it was a network problem on our side, it should be fine now
I close this discussion, please, ping me here in case of any questions about these models or open a new discussion