Update README.md
Browse files
README.md
CHANGED
@@ -1,43 +1,18 @@
|
|
1 |
-
---
|
2 |
-
license: mit
|
3 |
-
---
|
4 |
-
|
5 |
-
This is the fine-tuned MiniCPM-V-2_6 adapter for paper [**Automatic Evaluation for Text-to-Image Generation: Fine-grained Framework,
|
6 |
-
Distilled Evaluation Model and Meta-Evaluation Benchmark**]()
|
7 |
-
|
8 |
-
|
9 |
-
|
10 |
-
|
11 |
-
|
12 |
-
|
13 |
-
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
-
|
18 |
-
|
19 |
-
| BLIPv2Score | 0.2278 | 0.1588 | 0.2280 | 0.1617 | 0.2134 | 0.1477 | 0.2152 | 0.1423 |
|
20 |
-
| ImageReward | 0.4171 | 0.3065 | 0.3712 | 0.2690 | 0.4134 | 0.3030 | 0.4046 | 0.2839 |
|
21 |
-
| LLM/MLLM-Based Methods |
|
22 |
-
| LLMScore$_{GPT-4}$ | 0.3009 | 0.2212 | 0.2697 | 0.2012 | 0.3299 | 0.2497 | 0.3096 | 0.2228 |
|
23 |
-
| DSG$_{Dependent}$ | 0.4742 | 0.3790 | 0.4204 | 0.3339 | 0.4562 | 0.3652 | 0.4582 | 0.3512 |
|
24 |
-
| DSG$_{Independent}$ | 0.4815 | 0.3891 | 0.4382 | 0.3502 | 0.4721 | 0.3827 | 0.4704 | 0.3655 |
|
25 |
-
| VQAScore$_{CLIP-FlanT5}$ | 0.4984 | 0.3768 | 0.4864 | 0.3619 | 0.5118 | 0.3854 | 0.5116 | 0.3712 |
|
26 |
-
| VIEScore$_{MiniCPM-V-2.6}$ | 0.2834 | 0.2251 | 0.2814 | 0.2231 | 0.3016 | 0.2422 | 0.2941 | 0.2250 |
|
27 |
-
| VIEScore$_{MiniCPM-V-2.6}$ | 0.4906 | 0.3878 | 0.4869 | 0.3836 | 0.4889 | 0.3899 | 0.5101 | 0.3897 |
|
28 |
-
| VIEScore$_{GPT-4o}$ | **0.5522** | **0.4283** | 0.5306 | 0.4101 | 0.5170 | 0.4024 | 0.5545 | 0.4170 |
|
29 |
-
| Closed-Source MLLM with Our Pipeline |
|
30 |
-
| Ours$_{GPT-4o}$ | 0.5437 | 0.4302 | 0.5355 | 0.4214 | 0.5138 | 0.4061 | 0.5566 | 0.4285 |
|
31 |
-
| Our Fine-tuned Open-source MLLM |
|
32 |
-
| Ours$_{MiniCPM-V-2.6}$ | 0.5306 | 0.4214 | **0.6067** | **0.4769** | **0.5744** | **0.4563** | **0.5938** | **0.4566** |
|
33 |
-
|
34 |
-
|
35 |
-
## Quick Start
|
36 |
-
* Merge the adapter with original MiniCPM-V-2_6 checkpoint with [SWIFT](https://github.com/modelscope/ms-swift):
|
37 |
-
```shell
|
38 |
-
swift export \
|
39 |
-
--model_type minicpm-v-v2_6-chat \
|
40 |
-
--model_id_or_path openbmb/MiniCPM-V-2_6 \
|
41 |
-
--ckpt_dir /path/to/the/downloaded/adapter \
|
42 |
-
--merge_lora true
|
43 |
-
```
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
---
|
4 |
+
|
5 |
+
This is the fine-tuned MiniCPM-V-2_6 adapter for paper [**Automatic Evaluation for Text-to-Image Generation: Fine-grained Framework,
|
6 |
+
Distilled Evaluation Model and Meta-Evaluation Benchmark**]()
|
7 |
+
|
8 |
+
**NOTE**: Please check out [our github repository](https://github.com/maziao/T2I-Eval) for more detailed usage.
|
9 |
+
|
10 |
+
## Quick Start
|
11 |
+
* Merge the adapter with original MiniCPM-V-2_6 checkpoint with [SWIFT](https://github.com/modelscope/ms-swift):
|
12 |
+
```shell
|
13 |
+
swift export \
|
14 |
+
--model_type minicpm-v-v2_6-chat \
|
15 |
+
--model_id_or_path openbmb/MiniCPM-V-2_6 \
|
16 |
+
--ckpt_dir /path/to/the/downloaded/adapter \
|
17 |
+
--merge_lora true
|
18 |
+
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|