Spaces:

open-llm-leaderboard
/

open_llm_leaderboard

Running on CPU Upgrade

App Files Files Community

1049

Question: Will open LLM leadboard add some explicit coding benchmark?

#797

by Enigrand - opened Jun 27

Discussion

Enigrand

Jun 27

I see no coding benchmark for now.

Will open LLM leadboard add some explicit coding benchmark? Is there any difficulties? I didn't see any discussed in the blog.

clefourrier

Open LLM Leaderboard org Jun 27

Hi!

No, coding benchmarks are too time and compute consuming for the leaderboard at the moment; we really wanted to add some but we did not manage to find some which could fit in our compute constraints.

clefourrier changed discussion status to closed Jun 27

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment