model update
Browse files
README.md
CHANGED
@@ -18,7 +18,7 @@ widget:
|
|
18 |
example_title: "Question Generation Example 1"
|
19 |
- text: "generate question: Beyonce further expanded her acting career, starring as blues singer <hl> Etta James <hl> in the 2008 musical biopic, Cadillac Records."
|
20 |
example_title: "Question Generation Example 2"
|
21 |
-
- text: "generate question: Beyonce further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, <hl> Cadillac Records
|
22 |
example_title: "Question Generation Example 3"
|
23 |
model-index:
|
24 |
- name: lmqg/t5-base-squad-no-paragraph
|
@@ -33,19 +33,19 @@ model-index:
|
|
33 |
metrics:
|
34 |
- name: BLEU4
|
35 |
type: bleu4
|
36 |
-
value: 0.
|
37 |
- name: ROUGE-L
|
38 |
type: rouge-l
|
39 |
-
value: 0.
|
40 |
- name: METEOR
|
41 |
type: meteor
|
42 |
-
value: 0.
|
43 |
- name: BERTScore
|
44 |
type: bertscore
|
45 |
-
value: 0.
|
46 |
- name: MoverScore
|
47 |
type: moverscore
|
48 |
-
value: 0.
|
49 |
---
|
50 |
|
51 |
# Language Models Fine-tuning on Question Generation: `lmqg/t5-base-squad-no-paragraph`
|
@@ -81,7 +81,7 @@ question = pipe(input_text)
|
|
81 |
|
82 |
| Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
|
83 |
|:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
|
84 |
-
| [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) | default | 0.
|
85 |
|
86 |
|
87 |
|
|
|
18 |
example_title: "Question Generation Example 1"
|
19 |
- text: "generate question: Beyonce further expanded her acting career, starring as blues singer <hl> Etta James <hl> in the 2008 musical biopic, Cadillac Records."
|
20 |
example_title: "Question Generation Example 2"
|
21 |
+
- text: "generate question: Beyonce further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, <hl> Cadillac Records <hl> ."
|
22 |
example_title: "Question Generation Example 3"
|
23 |
model-index:
|
24 |
- name: lmqg/t5-base-squad-no-paragraph
|
|
|
33 |
metrics:
|
34 |
- name: BLEU4
|
35 |
type: bleu4
|
36 |
+
value: 0.24333113204169607
|
37 |
- name: ROUGE-L
|
38 |
type: rouge-l
|
39 |
+
value: 0.5180594839370757
|
40 |
- name: METEOR
|
41 |
type: meteor
|
42 |
+
value: 0.2581450886886534
|
43 |
- name: BERTScore
|
44 |
type: bertscore
|
45 |
+
value: 0.907275978890228
|
46 |
- name: MoverScore
|
47 |
type: moverscore
|
48 |
+
value: 0.6400353625885767
|
49 |
---
|
50 |
|
51 |
# Language Models Fine-tuning on Question Generation: `lmqg/t5-base-squad-no-paragraph`
|
|
|
81 |
|
82 |
| Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
|
83 |
|:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
|
84 |
+
| [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) | default | 0.24333113204169607 | 0.5180594839370757 | 0.2581450886886534 | 0.907275978890228 | 0.6400353625885767 | [link](https://huggingface.co/lmqg/t5-base-squad-no-paragraph/raw/main/eval/metric.first.sentence.sentence_answer.question.lmqg_qg_squad.default.json) |
|
85 |
|
86 |
|
87 |
|