Add evaluation results on the samsum config and test split of samsum

#1
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -183,6 +183,42 @@ parameters:
183
  repetition_penalty: 3.5
184
  encoder_no_repeat_ngram_size: 3
185
  num_beams: 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
186
  ---
187
 
188
  # pszemraj/pegasus-x-large-book-summary
 
183
  repetition_penalty: 3.5
184
  encoder_no_repeat_ngram_size: 3
185
  num_beams: 1
186
+ model-index:
187
+ - name: pszemraj/pegasus-x-large-book-summary
188
+ results:
189
+ - task:
190
+ type: summarization
191
+ name: Summarization
192
+ dataset:
193
+ name: samsum
194
+ type: samsum
195
+ config: samsum
196
+ split: test
197
+ metrics:
198
+ - name: ROUGE-1
199
+ type: rouge
200
+ value: 33.1401
201
+ verified: true
202
+ - name: ROUGE-2
203
+ type: rouge
204
+ value: 9.3095
205
+ verified: true
206
+ - name: ROUGE-L
207
+ type: rouge
208
+ value: 24.8552
209
+ verified: true
210
+ - name: ROUGE-LSUM
211
+ type: rouge
212
+ value: 29.0391
213
+ verified: true
214
+ - name: loss
215
+ type: loss
216
+ value: 2.288182497024536
217
+ verified: true
218
+ - name: gen_len
219
+ type: gen_len
220
+ value: 45.2173
221
+ verified: true
222
  ---
223
 
224
  # pszemraj/pegasus-x-large-book-summary