nebulae09 commited on
Commit
015f55a
Β·
verified Β·
1 Parent(s): 19bdd9e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -4
README.md CHANGED
@@ -1,15 +1,34 @@
1
  ---
2
- title: Open VLM Video Leaderboard
3
  emoji: 🌎
4
  colorFrom: blue
5
  colorTo: green
6
  sdk: gradio
7
- sdk_version: 4.15.0
8
  app_file: app.py
9
  pinned: true
10
  license: apache-2.0
11
  tags:
12
- - leaderboard
 
13
  ---
14
 
15
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Open VLM Leaderboard
3
  emoji: 🌎
4
  colorFrom: blue
5
  colorTo: green
6
  sdk: gradio
7
+ sdk_version: 4.44.0
8
  app_file: app.py
9
  pinned: true
10
  license: apache-2.0
11
  tags:
12
+ - leaderboard
13
+ short_description: 'VLMEvalKit Eval Results in video understanding benchmark'
14
  ---
15
 
16
+
17
+ In this leaderboard, we show the results of all video understanding metrics obtained using VLMEvalKit. The space provides an overall leaderboard with carefully selected benchmarks and total scores; And benchmarking leaderboards that provide overall and fine-grained scores for each video understanding benchmark.
18
+
19
+ Github: https://github.com/open-compass/VLMEvalKit
20
+ Report: https://arxiv.org/abs/2407.11691
21
+
22
+ Please consider to cite the report if the resource is useful to your research:
23
+
24
+ ```BibTex
25
+ @misc{duan2024vlmevalkitopensourcetoolkitevaluating,
26
+ title={VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Models},
27
+ author={Haodong Duan and Junming Yang and Yuxuan Qiao and Xinyu Fang and Lin Chen and Yuan Liu and Amit Agarwal and Zhe Chen and Mo Li and Yubo Ma and Hailong Sun and Xiangyu Zhao and Junbo Cui and Xiaoyi Dong and Yuhang Zang and Pan Zhang and Jiaqi Wang and Dahua Lin and Kai Chen},
28
+ year={2024},
29
+ eprint={2407.11691},
30
+ archivePrefix={arXiv},
31
+ primaryClass={cs.CV},
32
+ url={https://arxiv.org/abs/2407.11691},
33
+ }
34
+ ```