hummingbird
/
fastNLP
Not watched
2
0
Fork 0
Code
Releases 13 Wiki Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
1059 Commits
3 Branches
25 MB
1 Download
 
 
 
 
 
Tree: c588ba7820
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'c588ba7820'
${ noResults }
fastNLP/reproduction/Summarization
Danqing Wang c588ba7820 Merge BertSum and reorganize Summarization Task 6 years ago
..
Baseline Merge BertSum and reorganize Summarization Task 6 years ago
BertSum Merge BertSum and reorganize Summarization Task 6 years ago
config Add Summarization framework 6 years ago
data delete my fastnlp/io/dataset_loader.py and add test file 6 years ago
model update Readme.md 6 years ago
test delete my fastnlp/io/dataset_loader.py and add test file 6 years ago
tools Add Summarization framework 6 years ago
transformer Add Summarization framework 6 years ago
README.md update Readme.md 6 years ago
test_data.py delete my fastnlp/io/dataset_loader.py and add test file 6 years ago
train.py Add Summarization framework 6 years ago
train_origin.py Add Summarization framework 6 years ago
train_transformer.py Add Summarization framework 6 years ago

README.md

Summarization

Extractive Summarization

Models

FastNLP中实现的模型包括：

  1. Get To The Point: Summarization with Pointer-Generator Networks (See et al. 2017)
  2. Searching for Effective Neural Extractive Summarization What Works and What's Next (Zhong et al. 2019)

Dataset

这里提供的摘要任务数据集包括：

  • CNN/DailyMail
  • Newsroom
  • The New York Times Annotated Corpus
    • NYT
    • NYT50
  • DUC
    • 2002 Task4
    • 2003/2004 Task1
  • arXiv
  • PubMed

其中公开数据集(CNN/DailyMail, Newsroom, arXiv, PubMed)预处理之后的下载地址：

未公开数据集(NYT, NYT50, DUC)数据处理部分脚本放置于data文件夹

Dataset_loader

  • SummarizationLoader: 用于读取处理好的jsonl格式数据集，返回以下field
    • text: 文章正文
    • summary: 摘要
    • domain: 可选，文章发布网站
    • tag: 可选，文章内容标签
    • labels: 抽取式句子标签

Performance and Hyperparameters

| Model | ROUGE-1 | ROUGE-2 | ROUGE-L | Paper |
See

Abstractive Summarization

Still in Progress...

Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

一款轻量级的自然语言处理（NLP）工具包，目标是减少用户项目中的工程型代码，例如数据处理循环、训练循环、多卡运行等

Python Jupyter Notebook Text CSV Markdown