Demo leaderboard with an integrated backend

🚨 How green is your model? 🌱 Introducing a new feature in the Comparator tool: Environmental Impact for responsible #LLM research!
👉 open-llm-leaderboard/comparator
Now, you can not only compare models by performance, but also by their environmental footprint!

🌍 The Comparator calculates CO₂ emissions during evaluation and shows key model characteristics: evaluation score, number of parameters, architecture, precision, type... 🛠️
Make informed decisions about your model's impact on the planet and join the movement towards greener AI!

clefourrier

updated a dataset about 2 months ago

demo-leaderboard-backend/requests

Preview • Updated Nov 10 • 1.53k

AI & ML interests

Recent Activity

Team members 3

demo-leaderboard-backend's activity

Fix wrong instructions and code for custom tasks

Backend

Fix HFValidationError caused by wrong repo_id

Fix UnboundLocalError: local variable 'results' referenced before assignment

Fix UnboundLocalError: local variable 'results' referenced before assignment

Fix HFValidationError caused by wrong repo_id

Remove unused no_cache parameter

Fix different results filenames locally and in the Hub

Do not pass custom_tasks by default

Fix ModuleNotFoundError in custom_tasks

Remove unused no_cache parameter

Fix different results filenames locally and in the Hub

Do not pass custom_tasks by default

Fix ModuleNotFoundError in custom_tasks

Fix InferenceEndpoint name with / from model_id

Remove duplicate EvalRequest.model_type

Fix style