Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 12.4k

Running on CPU Upgrade

https://huggingface.co./datasets/open-llm-leaderboard/requests/commit/4af328af30116a02ddebb06ecf7e9c723217d3bd

Model_id: ehristoforu/testq-32b
Model_id: ehristoforu/qwen2.5-test-32b-it
Model_id: ehristoforu/frqwen2.5-from72b-duable10layers

No custom remote code, no edits in architechture, no edits in tokenizer, only mergekit merge
All configs imported from original Qwen models, that eval success

There are already many similar problems that are not being solved:

• https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard/discussions/1078
• https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard/discussions/1083
• https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard/discussions/1075
• https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard/discussions/1062

Please finally solve this problem, as many custom models simply cannot get into the leaderboard because of this error (I would like you to also look at the error logs and solve these errors, as the problem is clearly on your side)

Thanks in advance! I hope you will pay attention to this