Skip to content

A Topic-aware Pointer Model for Abstractive Summarization using Topic Relevance Loss

Notifications You must be signed in to change notification settings

BeckyWang/TPM_abstractive_summarization

Repository files navigation

TPM_abstractive_summarization

A Topic-aware Pointer Model for Abstractive Summarization using Topic Relevance Loss

Looking for baseline model

This code is based on the pointer-generator model

Note Baseline code is in Python 2. If you want a Python 3 version, see @becxer's fork.

How to get training/test dataset

This code can be used in Chinese and English datasets.

English datasets-CNN/Daily Mail, Instructions are here

Data preposessing

In our work, we firstly use the pre-trained topic model to get the topic information, then integrating it into the model from two aspects: pointer mechanism and attention mechanism.

The details of data preprocessing are available here.

How to run

Follow the instructions of pointer-generator model

Evaluate with ROUGE

If you are using an English dataset, you can use the Python package pyrouge to run ROUGE evaluation. Some useful instructions in pointer-generator model.

If you are using an Chinese dataset, just follow this code. We have implemented the ROUGE method ourselves in run_rouge.py.

About

A Topic-aware Pointer Model for Abstractive Summarization using Topic Relevance Loss

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages