Problem Statment:
Given a news article, generate a summary of two-to-three sentences and a headline for the article. The summary should be abstractive rather than extractive. In abstractive summarization, new sentences are generated as part of the summary and the sentences in the summary might not be present in the news article.
Model Description
This model builds on the google/pegasus-large model by finetuning it on a custom summary-headline dataset called inshorts. After finetuning, to generate an appropriate headline of an article, get the summary of the article first from the pegasus-large model and then pass the summary through this model. The two-way approach was taken to get apt headline from summary rather then generating the headline from the pegasus-large itself.
For more details about the project, click here.
- Downloads last month
- 15
Dataset used to train kubershahi/pegasus-inshorts
Evaluation results
- ROUGE-L-P on inshortsself-reported0.011
- ROUGE-L-R on inshortsself-reported0.083
- ROUGE-L-F on inshortsself-reported0.083
- ROUGE-1-P on inshortsself-reported0.011
- ROUGE-1-R on inshortsself-reported0.083
- ROUGE-1-f on inshortsself-reported0.083